Jul 01 16:28:37.309791 ip-10-0-135-32 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:28:37.691285 ip-10-0-135-32 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:28:37.691285 ip-10-0-135-32 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:28:37.691285 ip-10-0-135-32 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:28:37.691285 ip-10-0-135-32 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:28:37.691285 ip-10-0-135-32 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:28:37.692004 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.691345 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:28:37.696963 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696942 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:28:37.696963 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696963 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696967 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696971 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696974 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696977 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696981 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696984 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696987 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696990 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696994 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.696998 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697001 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697005 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697010 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697012 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697015 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697019 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697021 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697024 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:28:37.697042 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697027 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697030 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697033 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697035 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697038 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697041 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697043 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697046 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697049 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697052 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697055 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697057 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697060 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697063 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697065 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697068 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697071 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697073 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697077 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697079 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:28:37.697511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697082 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697084 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697088 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697091 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697094 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697097 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697100 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697102 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697105 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697107 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697109 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697112 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697114 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697117 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697120 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697124 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697126 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697129 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697131 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697134 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:28:37.698006 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697137 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697140 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697142 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697145 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697147 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697150 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697152 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697155 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697157 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697160 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697163 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697166 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697168 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697171 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697173 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697177 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697179 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697182 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697185 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697187 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:28:37.698510 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697190 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697192 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697194 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697197 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697199 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697202 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697206 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697208 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697211 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697214 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697216 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697219 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697221 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697224 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697226 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697229 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697231 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697234 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697236 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697992 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:28:37.699035 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.697999 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698003 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698006 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698009 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698015 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698018 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698021 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698024 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698026 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698029 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698032 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698035 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698037 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698040 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698043 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698046 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698048 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698051 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698056 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698060 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:28:37.699537 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698063 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698066 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698068 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698071 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698074 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698076 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698079 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698081 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698084 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698087 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698089 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698092 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698094 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698097 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698100 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698103 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698106 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698109 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698111 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:28:37.700030 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698114 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698116 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698119 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698122 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698124 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698127 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698130 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698132 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698134 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698137 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698140 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698143 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698145 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698148 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698150 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698153 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698155 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698158 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698160 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:28:37.700511 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698163 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698167 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698169 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698172 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698174 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698176 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698179 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698182 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698184 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698187 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698189 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698192 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698195 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698197 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698200 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698202 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698205 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698207 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698210 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698212 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:28:37.700988 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698214 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698217 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698219 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698222 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698225 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698228 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698230 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698233 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698235 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698238 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698242 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698245 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698247 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698249 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698252 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698254 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698257 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698259 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698263 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698267 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:28:37.701490 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698694 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698700 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698703 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698706 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698709 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698713 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698715 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698718 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698721 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698724 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698726 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698729 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698731 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698736 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698739 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698742 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698745 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698748 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698751 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:28:37.701984 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698753 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698756 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698758 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698761 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698763 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698766 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698769 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698771 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698774 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698776 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698778 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698781 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698783 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698786 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698788 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698791 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698794 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698796 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698799 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698801 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:28:37.702458 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698804 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698810 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698813 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698815 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698818 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698821 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698824 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698826 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698829 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698832 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698835 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698839 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698841 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698844 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698846 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698848 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698851 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698854 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698856 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:28:37.702969 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698858 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698861 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698863 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698866 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698869 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698871 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698874 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698876 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698878 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698881 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698883 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698886 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698889 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698892 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698898 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698901 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698904 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698906 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698909 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698911 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:28:37.703433 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698914 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698935 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698939 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698942 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698945 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698948 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698953 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698957 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698959 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698963 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698965 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698968 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698971 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698973 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698976 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698978 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698981 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698983 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698986 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698988 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:28:37.703978 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.698991 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699069 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699077 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699091 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699097 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699105 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699114 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699119 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699123 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699126 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699130 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699133 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699136 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699139 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699142 2562 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699145 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699149 2562 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699152 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699154 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699160 2562 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699162 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699165 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699168 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699172 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:28:37.704468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699176 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699178 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699181 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699185 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699188 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699190 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699193 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699196 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699199 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699203 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699206 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699209 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699212 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699215 2562 flags.go:64] FLAG: --enable-server="true" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699221 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699225 2562 flags.go:64] FLAG: --event-burst="100" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699228 2562 flags.go:64] FLAG: --event-qps="50" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699231 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699234 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699237 2562 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699241 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699244 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699246 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699250 2562 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699252 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:28:37.705076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699255 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699258 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699261 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699264 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699267 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699269 2562 flags.go:64] FLAG: --feature-gates="" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699273 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699276 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699279 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699282 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699285 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699288 2562 flags.go:64] FLAG: --help="false" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699291 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-32.ec2.internal" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699294 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699297 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699299 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699303 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699306 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699308 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699311 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699314 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699319 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699326 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699329 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:28:37.705725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699332 2562 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699335 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699338 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699341 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699343 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699346 2562 flags.go:64] FLAG: --lock-file="" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699349 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699352 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699355 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699360 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699363 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699366 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699369 2562 flags.go:64] FLAG: --logging-format="text" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699371 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699375 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699377 2562 flags.go:64] FLAG: --manifest-url="" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699380 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699384 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699387 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699391 2562 flags.go:64] FLAG: --max-pods="110" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699394 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699397 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699400 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699403 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699405 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:28:37.706328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699408 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699411 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699418 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699421 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699426 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699429 2562 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699446 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699453 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699456 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699459 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699462 2562 flags.go:64] FLAG: --port="10250" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699465 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699468 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0154100b660450789" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699471 2562 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699488 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699491 2562 flags.go:64] FLAG: --register-node="true" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699494 2562 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699498 2562 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699501 2562 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699503 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699506 2562 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699510 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699513 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699517 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699519 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:28:37.706957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699522 2562 flags.go:64] FLAG: --runonce="false" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699525 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699528 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699531 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699534 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699536 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699539 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699543 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699546 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699549 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699552 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699555 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699560 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699563 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699576 2562 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699579 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699585 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699588 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699590 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699598 2562 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699601 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699603 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699606 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699609 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699612 2562 flags.go:64] FLAG: --v="2" Jul 01 16:28:37.707761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699616 2562 flags.go:64] FLAG: --version="false" Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699620 2562 flags.go:64] FLAG: --vmodule="" Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699623 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.699626 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699753 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699757 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699760 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699763 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699766 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699769 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699772 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699775 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699779 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699783 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699786 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699788 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699791 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699793 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699796 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699801 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:28:37.708396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699803 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699806 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699810 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699814 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699817 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699820 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699823 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699826 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699829 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699831 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699834 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699836 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699839 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699841 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699844 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699846 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699849 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699851 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699854 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:28:37.708896 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699856 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699859 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699861 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699864 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699866 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699869 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699871 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699874 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699877 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699879 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699881 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699884 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699889 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699891 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699894 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699896 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699900 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699902 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699905 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699908 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:28:37.709376 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699910 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699912 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699915 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699917 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699920 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699922 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699925 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699928 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699930 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699934 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699937 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699940 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699943 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699945 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699948 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699951 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699953 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699956 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699958 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:28:37.709898 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699961 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699964 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699966 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699969 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699971 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699975 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699978 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699980 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699983 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699985 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699995 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.699997 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700000 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700002 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700005 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700008 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700010 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700013 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700015 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700018 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:28:37.710364 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700021 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700023 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700026 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700029 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.700031 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.700546 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.707420 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.707449 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.708289 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.708298 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708360 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708367 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708371 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708374 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:28:37.710869 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708378 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708380 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708383 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708386 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708389 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708392 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708395 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708398 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708401 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708404 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708407 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708410 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708413 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708415 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708418 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708421 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708423 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708426 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708429 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:28:37.711221 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708431 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708434 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708436 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708439 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708441 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708446 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708450 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708453 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708456 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708459 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708462 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708466 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708468 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708471 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708494 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708497 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708500 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708503 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708506 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:28:37.711709 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708509 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708511 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708514 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708517 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708519 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708522 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708525 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708527 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708530 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708533 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708535 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708538 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708541 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708544 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708546 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708549 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708552 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708554 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708557 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708560 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:28:37.712185 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708564 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708566 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708569 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708571 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708574 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708576 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708579 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708581 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708584 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708586 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708589 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708591 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708594 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708596 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708599 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708601 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708604 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708606 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708609 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708611 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:28:37.712704 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708614 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708617 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708619 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708622 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708624 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708627 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708629 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708631 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708634 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708636 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708639 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708642 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708646 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708650 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708653 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708655 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:28:37.713192 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708658 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.708663 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708780 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708786 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708790 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708793 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708796 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708800 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708803 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708805 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708808 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708811 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708814 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708816 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:28:37.713742 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708819 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708821 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708824 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708826 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708829 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708831 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708834 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708836 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708839 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708841 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708844 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708846 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708848 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708852 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708854 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708857 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708860 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708862 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708865 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708869 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:28:37.714094 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708872 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708875 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708878 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708881 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708883 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708886 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708888 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708891 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708894 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708897 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708900 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708903 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708905 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708908 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708911 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708914 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708917 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708919 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708922 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708924 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:28:37.714587 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708927 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708929 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708932 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708934 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708937 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708939 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708942 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708944 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708947 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708951 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708953 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708956 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708958 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708961 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708964 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708966 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708968 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708971 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708973 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708976 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:28:37.715067 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708979 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708981 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708984 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708986 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708989 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708991 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708994 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708996 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.708999 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709001 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709004 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709006 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709009 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709011 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709014 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709016 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709019 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709022 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709024 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:28:37.715575 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709028 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709031 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709035 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709038 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709040 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709043 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709045 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:37.709048 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.709053 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.709180 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.711170 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.712607 2562 server.go:1019] "Starting client certificate rotation" Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.712706 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:28:37.716043 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.712737 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:28:37.716570 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.716173 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:28:37.722982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.722952 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:28:37.731132 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.731111 2562 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:28:37.733135 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.733117 2562 log.go:25] "Validated CRI v1 image API" Jul 01 16:28:37.734077 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.734054 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:28:37.737877 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.737853 2562 fs.go:135] Filesystem UUIDs: map[3ce63dc1-48da-4526-8b74-2528534222b6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bf719b66-6eb6-453a-b83a-873341591d1e:/dev/nvme0n1p3] Jul 01 16:28:37.737976 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.737875 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:28:37.742276 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.742150 2562 manager.go:216] Machine: {Timestamp:2026-07-01 16:28:37.741636862 +0000 UTC m=+0.317329142 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3085435 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f1d6425210d7adef66c0c140df9c SystemUUID:ec24f1d6-4252-10d7-adef-66c0c140df9c BootID:b6ff87d8-56d2-4592-bcd7-14c5e0dd078a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:d0:4a:ed:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:d0:4a:ed:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:1c:bb:75:dc:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:28:37.742276 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.742262 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:28:37.742499 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.742375 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:28:37.742712 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.742694 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:28:37.745200 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.745174 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:28:37.745350 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.745203 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:28:37.745946 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.745936 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:28:37.745987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.745948 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:28:37.745987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.745956 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:28:37.746610 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.746599 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:28:37.747434 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.747425 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:28:37.750055 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750043 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:28:37.750349 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750339 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:28:37.750388 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750372 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:28:37.750426 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750393 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:28:37.750426 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750404 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:28:37.750426 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750414 2562 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:28:37.750426 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750423 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:28:37.750789 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750778 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:28:37.750819 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.750797 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:28:37.753809 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.753785 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:28:37.755113 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.755099 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:28:37.755159 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.755130 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:28:37.756110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756097 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:28:37.756145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756117 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:28:37.756145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756123 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:28:37.756145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756129 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:28:37.756145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756137 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:28:37.756145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756142 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:28:37.756278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756150 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:28:37.756278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756155 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:28:37.756278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756164 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:28:37.756278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756170 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:28:37.756278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756178 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:28:37.756278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.756184 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:28:37.757024 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.757012 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:28:37.757057 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.757029 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:28:37.761412 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.761394 2562 server.go:1268] "Started kubelet" Jul 01 16:28:37.761583 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.761523 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:28:37.761679 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.761554 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:28:37.761679 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.761606 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:28:37.762457 ip-10-0-135-32 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:28:37.762782 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.762763 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:28:37.764143 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.764100 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ndvr7" Jul 01 16:28:37.764664 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.764647 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:28:37.764937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.764912 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:28:37.765610 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.765575 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:28:37.765693 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.765578 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:28:37.767975 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.767959 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:28:37.768238 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768220 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:28:37.768238 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768227 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:28:37.768364 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.768285 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:37.768861 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768841 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:28:37.768861 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768842 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:28:37.768968 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768870 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:28:37.769011 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768968 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:28:37.769011 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.768981 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:28:37.769229 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769202 2562 factory.go:55] Registering systemd factory Jul 01 16:28:37.769229 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769221 2562 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:28:37.769428 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769412 2562 factory.go:153] Registering CRI-O factory Jul 01 16:28:37.769517 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769432 2562 factory.go:223] Registration of the crio container factory successfully Jul 01 16:28:37.769517 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769503 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:28:37.769613 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769527 2562 factory.go:103] Registering Raw factory Jul 01 16:28:37.769613 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769542 2562 manager.go:1196] Started watching for new ooms in manager Jul 01 16:28:37.769960 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.769946 2562 manager.go:349] Starting recovery of all containers Jul 01 16:28:37.771919 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.771894 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ndvr7" Jul 01 16:28:37.777932 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.777768 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:28:37.778063 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.777856 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:28:37.781470 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.779384 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-32.ec2.internal.18be374fa8ed332c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-32.ec2.internal,UID:ip-10-0-135-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-32.ec2.internal,},FirstTimestamp:2026-07-01 16:28:37.761356588 +0000 UTC m=+0.337048905,LastTimestamp:2026-07-01 16:28:37.761356588 +0000 UTC m=+0.337048905,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-32.ec2.internal,}" Jul 01 16:28:37.781886 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.781859 2562 manager.go:354] Recovery completed Jul 01 16:28:37.788522 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.788509 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.790924 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.790907 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.790984 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.790940 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.790984 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.790951 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.791472 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.791455 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:28:37.791472 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.791468 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:28:37.791472 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.791501 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:28:37.791636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.791471 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.792272 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.792258 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.792342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.792282 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.792342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.792291 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.792547 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.792536 2562 policy_none.go:49] "None policy: Start" Jul 01 16:28:37.792593 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.792552 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:28:37.792593 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.792562 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:28:37.793489 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.793467 2562 policy_none.go:47] "Start" Jul 01 16:28:37.842196 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842174 2562 manager.go:337] "Starting Device Plugin manager" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.842221 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842235 2562 server.go:87] "Starting device plugin registration server" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842570 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842583 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842650 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842743 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.842753 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.843295 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.843348 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.846702 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.848085 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.848125 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.848147 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:28:37.854222 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.848179 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:28:37.862916 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.862896 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:28:37.943601 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.943523 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.944778 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.944759 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.944870 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.944794 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.944870 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.944805 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.944870 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.944832 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-32.ec2.internal" Jul 01 16:28:37.948914 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.948894 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"] Jul 01 16:28:37.948988 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.948968 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.950445 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.950428 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.950542 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.950457 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.950542 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.950467 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.952579 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.952563 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-32.ec2.internal" Jul 01 16:28:37.952628 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.952590 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-32.ec2.internal\": node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:37.952707 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.952695 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.952798 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.952785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:37.952847 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.952822 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.953521 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.953506 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.953585 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.953538 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.953585 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.953549 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.953659 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.953506 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.953659 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.953611 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.953659 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.953625 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.955375 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.955348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 01 16:28:37.955513 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.955392 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:28:37.956278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.956259 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:28:37.956387 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.956288 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:28:37.956387 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:37.956302 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:28:37.966527 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.966509 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:37.982420 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.982392 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal" Jul 01 16:28:37.987014 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:37.986994 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-32.ec2.internal\" not found" node="ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.067453 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.067406 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.069688 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.069670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4df39c04828e5e87c04098085e7c6ee6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"4df39c04828e5e87c04098085e7c6ee6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.069744 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.069695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4df39c04828e5e87c04098085e7c6ee6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"4df39c04828e5e87c04098085e7c6ee6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.069744 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.069716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9780f0e5ad59932d715562fcbe9c29d6-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"9780f0e5ad59932d715562fcbe9c29d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.167947 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.167915 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.170166 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.170146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4df39c04828e5e87c04098085e7c6ee6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"4df39c04828e5e87c04098085e7c6ee6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.170242 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.170175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9780f0e5ad59932d715562fcbe9c29d6-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"9780f0e5ad59932d715562fcbe9c29d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.170242 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.170199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4df39c04828e5e87c04098085e7c6ee6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"4df39c04828e5e87c04098085e7c6ee6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.170242 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.170228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9780f0e5ad59932d715562fcbe9c29d6-config\") pod \"kube-apiserver-proxy-ip-10-0-135-32.ec2.internal\" (UID: \"9780f0e5ad59932d715562fcbe9c29d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.170342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.170237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4df39c04828e5e87c04098085e7c6ee6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"4df39c04828e5e87c04098085e7c6ee6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.170342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.170266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4df39c04828e5e87c04098085e7c6ee6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal\" (UID: \"4df39c04828e5e87c04098085e7c6ee6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.268698 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.268622 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.285951 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.285921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.290003 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.289986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.369090 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.369048 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.469542 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.469503 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.570009 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.569928 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.670451 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.670417 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-32.ec2.internal\" not found" Jul 01 16:28:38.712732 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.712699 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:28:38.713295 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.712857 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:28:38.732269 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.732240 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:28:38.734894 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.734876 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:28:38.750845 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.750820 2562 apiserver.go:52] "Watching apiserver" Jul 01 16:28:38.758792 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.758769 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:28:38.759101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.759077 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8","openshift-cluster-node-tuning-operator/tuned-hkhmw","openshift-dns/node-resolver-8k45g","openshift-image-registry/node-ca-d42pq","openshift-network-diagnostics/network-check-target-l64q8","kube-system/global-pull-secret-syncer-tgx29","kube-system/konnectivity-agent-4gsxd","openshift-multus/multus-additional-cni-plugins-cdnk5","openshift-multus/multus-hcxk7","openshift-multus/network-metrics-daemon-g5vvh","openshift-network-operator/iptables-alerter-kkdhb","openshift-ovn-kubernetes/ovnkube-node-dm4ck"] Jul 01 16:28:38.760494 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.760461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.761570 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.761541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.762404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.762387 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.763351 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.763323 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4nzcl\"" Jul 01 16:28:38.763462 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.763405 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.763582 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.763562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:28:38.763978 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.763931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.764057 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.764041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.764407 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.764389 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mlkdm\"" Jul 01 16:28:38.764841 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.764823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.765538 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.765280 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.765645 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.765548 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bm7jb\"" Jul 01 16:28:38.765645 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.765593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:38.765645 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.765617 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.765792 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.765687 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:38.766234 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.766024 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.766883 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.766866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.766976 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.766920 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.766976 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.766935 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:38.767196 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.767169 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nznzd\"" Jul 01 16:28:38.767279 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.767265 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:28:38.767432 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.767416 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.768091 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.768067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.768323 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.768297 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:28:38.768438 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.768425 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.769842 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.769822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.770558 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.770541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:28:38.770646 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.770626 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:28:38.771056 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.771042 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.771601 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.771580 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vf7gp\"" Jul 01 16:28:38.771905 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.771891 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.772101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:38.772151 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772099 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:28:38.772151 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.772134 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:38.772365 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772352 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.772451 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772438 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:28:38.772597 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772582 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:28:38.772660 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.772660 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5xgd\" (UniqueName: \"kubernetes.io/projected/0325fca5-0779-4946-be6e-63eaae5120ce-kube-api-access-z5xgd\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.772747 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-run\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.772747 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5577m\"" Jul 01 16:28:38.772747 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:38.772913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.772913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-socket-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.772913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-kubernetes\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.772913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysctl-d\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.772913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-host\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-dbus\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-device-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.772985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-tuned\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-tmp\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsgj5\" (UniqueName: \"kubernetes.io/projected/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-kube-api-access-tsgj5\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-kubelet-config\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c151de77-21a2-46bf-b289-3bed524e8a56-agent-certs\") pod \"konnectivity-agent-4gsxd\" (UID: \"c151de77-21a2-46bf-b289-3bed524e8a56\") " pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.773118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysctl-conf\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysconfig\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-systemd\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-lib-modules\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-var-lib-kubelet\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773254 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-cnibin\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773324 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-registration-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4809f2d1-90dc-4499-9559-d31551ade25c-hosts-file\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.773526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p75j\" (UniqueName: \"kubernetes.io/projected/4809f2d1-90dc-4499-9559-d31551ade25c-kube-api-access-8p75j\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.773933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8wc7m\"" Jul 01 16:28:38.773933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4809f2d1-90dc-4499-9559-d31551ade25c-tmp-dir\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.773933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c54ccd70-1122-45ee-bd23-12c3535cfe86-serviceca\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.773933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-system-cni-dir\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.773933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-os-release\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.773933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-sys-fs\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.774117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-modprobe-d\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.774117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.773987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-sys\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.774117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.774009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c54ccd70-1122-45ee-bd23-12c3535cfe86-host\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.774117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.774029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlsd\" (UniqueName: \"kubernetes.io/projected/c54ccd70-1122-45ee-bd23-12c3535cfe86-kube-api-access-zwlsd\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.774117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.774055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c151de77-21a2-46bf-b289-3bed524e8a56-konnectivity-ca\") pod \"konnectivity-agent-4gsxd\" (UID: \"c151de77-21a2-46bf-b289-3bed524e8a56\") " pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.774117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.774087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.774369 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.774117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4j6x\" (UniqueName: \"kubernetes.io/projected/22124612-6bae-48e5-ad05-ddc1650ceeac-kube-api-access-l4j6x\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.774592 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.774578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.775621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.775604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:28:38.775979 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.775958 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.775979 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.775968 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g26cp\"" Jul 01 16:28:38.776102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.775961 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.777356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.777327 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:28:38.777356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.777354 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:28:38.777525 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.777368 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:28:38.777525 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.777381 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dwsmc\"" Jul 01 16:28:38.777525 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.777356 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:28:38.778826 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.778590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:28:38.778826 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.778689 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:28:38.779490 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.779455 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:28:38.779561 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.779498 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal"] Jul 01 16:28:38.779561 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.779533 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" Jul 01 16:28:38.784488 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.784436 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:23:38 +0000 UTC" deadline="2027-11-30 05:18:04.27080189 +0000 UTC" Jul 01 16:28:38.784488 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.784471 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12396h49m25.486333126s" Jul 01 16:28:38.784603 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.784493 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:28:38.790015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.789996 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:28:38.790278 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.790250 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal"] Jul 01 16:28:38.804739 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.804715 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kpx2w" Jul 01 16:28:38.812122 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.812099 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kpx2w" Jul 01 16:28:38.856167 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.856140 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:28:38.869757 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.869734 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:28:38.874607 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-conf-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.874715 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-kubelet\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.874715 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.874715 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbfj\" (UniqueName: \"kubernetes.io/projected/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-kube-api-access-qxbfj\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.874715 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-modprobe-d\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.874835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-sys\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.874835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-sys\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.874835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-slash\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.874835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-node-log\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.874835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-modprobe-d\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovn-node-metrics-cert\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-netns\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovnkube-script-lib\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-socket-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysctl-d\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.874952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-dbus\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.875059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-dbus\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-run-netns\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysctl-d\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-etc-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-socket-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsgj5\" (UniqueName: \"kubernetes.io/projected/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-kube-api-access-tsgj5\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-kubelet-config\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-multus-certs\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-cni-bin\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-kubelet-config\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-system-cni-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.875496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-systemd\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-lib-modules\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbt8c\" (UniqueName: \"kubernetes.io/projected/c66420fd-91fb-4735-b34c-fde305faf93b-kube-api-access-lbt8c\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-hostroot\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-systemd\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-registration-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-cni-binary-copy\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c66420fd-91fb-4735-b34c-fde305faf93b-iptables-alerter-script\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-lib-modules\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4809f2d1-90dc-4499-9559-d31551ade25c-tmp-dir\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875696 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-registration-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c54ccd70-1122-45ee-bd23-12c3535cfe86-serviceca\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/182bc735-1743-4a07-9fa7-5289de42e45f-cni-binary-copy\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-system-cni-dir\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-os-release\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.876280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-sys-fs\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c54ccd70-1122-45ee-bd23-12c3535cfe86-host\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-system-cni-dir\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-sys-fs\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlsd\" (UniqueName: \"kubernetes.io/projected/c54ccd70-1122-45ee-bd23-12c3535cfe86-kube-api-access-zwlsd\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c54ccd70-1122-45ee-bd23-12c3535cfe86-host\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-systemd-units\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4809f2d1-90dc-4499-9559-d31551ade25c-tmp-dir\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.875982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c151de77-21a2-46bf-b289-3bed524e8a56-konnectivity-ca\") pod \"konnectivity-agent-4gsxd\" (UID: \"c151de77-21a2-46bf-b289-3bed524e8a56\") " pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4j6x\" (UniqueName: \"kubernetes.io/projected/22124612-6bae-48e5-ad05-ddc1650ceeac-kube-api-access-l4j6x\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22124612-6bae-48e5-ad05-ddc1650ceeac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5xgd\" (UniqueName: \"kubernetes.io/projected/0325fca5-0779-4946-be6e-63eaae5120ce-kube-api-access-z5xgd\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-run\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-cni-multus\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.877098 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c54ccd70-1122-45ee-bd23-12c3535cfe86-serviceca\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-kubernetes\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-host\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-kubernetes\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876252 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-run\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-kubelet\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-systemd\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-host\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-ovn\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-log-socket\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-os-release\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovnkube-config\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-device-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876434 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c151de77-21a2-46bf-b289-3bed524e8a56-konnectivity-ca\") pod \"konnectivity-agent-4gsxd\" (UID: \"c151de77-21a2-46bf-b289-3bed524e8a56\") " pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-tuned\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-tmp\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878097 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-cni-bin\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qpq7\" (UniqueName: \"kubernetes.io/projected/182bc735-1743-4a07-9fa7-5289de42e45f-kube-api-access-5qpq7\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876543 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-env-overrides\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-device-dir\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c151de77-21a2-46bf-b289-3bed524e8a56-agent-certs\") pod \"konnectivity-agent-4gsxd\" (UID: \"c151de77-21a2-46bf-b289-3bed524e8a56\") " pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysctl-conf\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c66420fd-91fb-4735-b34c-fde305faf93b-host-slash\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-socket-dir-parent\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysconfig\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.876704 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysctl-conf\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-var-lib-kubelet\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-sysconfig\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-var-lib-kubelet\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876767 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:28:38.878957 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.876783 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:39.376759868 +0000 UTC m=+1.952452152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-cni-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-cnibin\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-k8s-cni-cncf-io\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-var-lib-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-cni-netd\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-cnibin\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22124612-6bae-48e5-ad05-ddc1650ceeac-cnibin\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.876992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4809f2d1-90dc-4499-9559-d31551ade25c-hosts-file\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p75j\" (UniqueName: \"kubernetes.io/projected/4809f2d1-90dc-4499-9559-d31551ade25c-kube-api-access-8p75j\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd4tx\" (UniqueName: \"kubernetes.io/projected/79b89364-2abe-4125-be3a-1a96a0c1379c-kube-api-access-xd4tx\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4809f2d1-90dc-4499-9559-d31551ade25c-hosts-file\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-os-release\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0325fca5-0779-4946-be6e-63eaae5120ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/182bc735-1743-4a07-9fa7-5289de42e45f-multus-daemon-config\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.877114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-etc-kubernetes\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.879718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.879717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-tmp\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.880186 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.879735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-etc-tuned\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.880186 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.879979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c151de77-21a2-46bf-b289-3bed524e8a56-agent-certs\") pod \"konnectivity-agent-4gsxd\" (UID: \"c151de77-21a2-46bf-b289-3bed524e8a56\") " pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:38.887490 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.887444 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:28:38.887490 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.887469 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:28:38.887708 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.887498 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:38.887708 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.887606 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:39.387587385 +0000 UTC m=+1.963279674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:38.890173 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.890152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlsd\" (UniqueName: \"kubernetes.io/projected/c54ccd70-1122-45ee-bd23-12c3535cfe86-kube-api-access-zwlsd\") pod \"node-ca-d42pq\" (UID: \"c54ccd70-1122-45ee-bd23-12c3535cfe86\") " pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:38.890308 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.890288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p75j\" (UniqueName: \"kubernetes.io/projected/4809f2d1-90dc-4499-9559-d31551ade25c-kube-api-access-8p75j\") pod \"node-resolver-8k45g\" (UID: \"4809f2d1-90dc-4499-9559-d31551ade25c\") " pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:38.890348 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.890288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsgj5\" (UniqueName: \"kubernetes.io/projected/2bc69076-97c2-4ed2-87c2-3c19592dc1ee-kube-api-access-tsgj5\") pod \"tuned-hkhmw\" (UID: \"2bc69076-97c2-4ed2-87c2-3c19592dc1ee\") " pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:38.890516 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.890498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5xgd\" (UniqueName: \"kubernetes.io/projected/0325fca5-0779-4946-be6e-63eaae5120ce-kube-api-access-z5xgd\") pod \"aws-ebs-csi-driver-node-vbsr8\" (UID: \"0325fca5-0779-4946-be6e-63eaae5120ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:38.890583 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.890563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4j6x\" (UniqueName: \"kubernetes.io/projected/22124612-6bae-48e5-ad05-ddc1650ceeac-kube-api-access-l4j6x\") pod \"multus-additional-cni-plugins-cdnk5\" (UID: \"22124612-6bae-48e5-ad05-ddc1650ceeac\") " pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:38.977727 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbt8c\" (UniqueName: \"kubernetes.io/projected/c66420fd-91fb-4735-b34c-fde305faf93b-kube-api-access-lbt8c\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.977727 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-hostroot\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c66420fd-91fb-4735-b34c-fde305faf93b-iptables-alerter-script\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/182bc735-1743-4a07-9fa7-5289de42e45f-cni-binary-copy\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-systemd-units\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977822 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-hostroot\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-cni-multus\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-systemd-units\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-kubelet\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-systemd\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-cni-multus\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-systemd\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-kubelet\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-ovn\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.977985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-log-socket\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovnkube-config\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-log-socket\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-cni-bin\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-ovn\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qpq7\" (UniqueName: \"kubernetes.io/projected/182bc735-1743-4a07-9fa7-5289de42e45f-kube-api-access-5qpq7\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-env-overrides\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-var-lib-cni-bin\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c66420fd-91fb-4735-b34c-fde305faf93b-host-slash\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-socket-dir-parent\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c66420fd-91fb-4735-b34c-fde305faf93b-host-slash\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-cni-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978224 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-cnibin\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-socket-dir-parent\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-k8s-cni-cncf-io\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-var-lib-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-cni-netd\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-cni-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-cnibin\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd4tx\" (UniqueName: \"kubernetes.io/projected/79b89364-2abe-4125-be3a-1a96a0c1379c-kube-api-access-xd4tx\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:38.978937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-os-release\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978372 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-var-lib-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-cni-netd\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/182bc735-1743-4a07-9fa7-5289de42e45f-multus-daemon-config\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-k8s-cni-cncf-io\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-etc-kubernetes\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-etc-kubernetes\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c66420fd-91fb-4735-b34c-fde305faf93b-iptables-alerter-script\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-os-release\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-conf-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovnkube-config\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-env-overrides\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-kubelet\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-multus-conf-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978660 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-kubelet\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbfj\" (UniqueName: \"kubernetes.io/projected/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-kube-api-access-qxbfj\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.979636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-slash\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-node-log\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-slash\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovn-node-metrics-cert\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-netns\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovnkube-script-lib\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-node-log\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-run-netns\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978823 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-netns\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-etc-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/182bc735-1743-4a07-9fa7-5289de42e45f-cni-binary-copy\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/182bc735-1743-4a07-9fa7-5289de42e45f-multus-daemon-config\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-run-netns\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-multus-certs\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-etc-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-run-openvswitch\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-host-run-multus-certs\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980145 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-cni-bin\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.978995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.979038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-host-cni-bin\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.979069 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.979110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-system-cni-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.979070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/182bc735-1743-4a07-9fa7-5289de42e45f-system-cni-dir\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:38.979148 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:28:39.479130371 +0000 UTC m=+2.054822654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:38.980667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.979243 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovnkube-script-lib\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.981131 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.981108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-ovn-node-metrics-cert\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.986267 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.986237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbt8c\" (UniqueName: \"kubernetes.io/projected/c66420fd-91fb-4735-b34c-fde305faf93b-kube-api-access-lbt8c\") pod \"iptables-alerter-kkdhb\" (UID: \"c66420fd-91fb-4735-b34c-fde305faf93b\") " pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:38.987320 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.987299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbfj\" (UniqueName: \"kubernetes.io/projected/db59440d-ebeb-4a5a-a88c-1a14bdfe0875-kube-api-access-qxbfj\") pod \"ovnkube-node-dm4ck\" (UID: \"db59440d-ebeb-4a5a-a88c-1a14bdfe0875\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:38.987395 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.987360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd4tx\" (UniqueName: \"kubernetes.io/projected/79b89364-2abe-4125-be3a-1a96a0c1379c-kube-api-access-xd4tx\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:38.991572 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:38.991553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qpq7\" (UniqueName: \"kubernetes.io/projected/182bc735-1743-4a07-9fa7-5289de42e45f-kube-api-access-5qpq7\") pod \"multus-hcxk7\" (UID: \"182bc735-1743-4a07-9fa7-5289de42e45f\") " pod="openshift-multus/multus-hcxk7" Jul 01 16:28:39.029826 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.029784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df39c04828e5e87c04098085e7c6ee6.slice/crio-b7c358d9b521627e32403dc1239e9d39f4f41a0f4eb3340865707ef5f988b820 WatchSource:0}: Error finding container b7c358d9b521627e32403dc1239e9d39f4f41a0f4eb3340865707ef5f988b820: Status 404 returned error can't find the container with id b7c358d9b521627e32403dc1239e9d39f4f41a0f4eb3340865707ef5f988b820 Jul 01 16:28:39.030110 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.030090 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9780f0e5ad59932d715562fcbe9c29d6.slice/crio-b47a81bf8189169b1a86e3009b359ce836617a8fa31e1adca0390e515701231f WatchSource:0}: Error finding container b47a81bf8189169b1a86e3009b359ce836617a8fa31e1adca0390e515701231f: Status 404 returned error can't find the container with id b47a81bf8189169b1a86e3009b359ce836617a8fa31e1adca0390e515701231f Jul 01 16:28:39.033892 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.033876 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:28:39.091799 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.091714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" Jul 01 16:28:39.099842 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.099800 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0325fca5_0779_4946_be6e_63eaae5120ce.slice/crio-f6539941013a7fc068a4d1bbf5601f8031d22c04072fc2a82d58a350cca9365e WatchSource:0}: Error finding container f6539941013a7fc068a4d1bbf5601f8031d22c04072fc2a82d58a350cca9365e: Status 404 returned error can't find the container with id f6539941013a7fc068a4d1bbf5601f8031d22c04072fc2a82d58a350cca9365e Jul 01 16:28:39.111689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.111668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" Jul 01 16:28:39.117896 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.117875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8k45g" Jul 01 16:28:39.119948 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.119919 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc69076_97c2_4ed2_87c2_3c19592dc1ee.slice/crio-5686473ea4a8f8ead8c3f3465d84ad74d0d87c51458971b6e7c4ce7985ef809e WatchSource:0}: Error finding container 5686473ea4a8f8ead8c3f3465d84ad74d0d87c51458971b6e7c4ce7985ef809e: Status 404 returned error can't find the container with id 5686473ea4a8f8ead8c3f3465d84ad74d0d87c51458971b6e7c4ce7985ef809e Jul 01 16:28:39.126226 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.126194 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4809f2d1_90dc_4499_9559_d31551ade25c.slice/crio-532dea358f6fa1e32056862646cc790e6692d66b3bf277961d386aaf01af552d WatchSource:0}: Error finding container 532dea358f6fa1e32056862646cc790e6692d66b3bf277961d386aaf01af552d: Status 404 returned error can't find the container with id 532dea358f6fa1e32056862646cc790e6692d66b3bf277961d386aaf01af552d Jul 01 16:28:39.137067 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.137044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d42pq" Jul 01 16:28:39.144839 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.144816 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54ccd70_1122_45ee_bd23_12c3535cfe86.slice/crio-72f15bc7d097a9fcef20f6daab0c9c06c745c34a4007155a163556ff51bc394f WatchSource:0}: Error finding container 72f15bc7d097a9fcef20f6daab0c9c06c745c34a4007155a163556ff51bc394f: Status 404 returned error can't find the container with id 72f15bc7d097a9fcef20f6daab0c9c06c745c34a4007155a163556ff51bc394f Jul 01 16:28:39.154566 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.154522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:39.162644 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.162617 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc151de77_21a2_46bf_b289_3bed524e8a56.slice/crio-d60876f1bcb1725e04e3a0dcb7adfe15bafbba8cea741090fa6bb1cda6758f51 WatchSource:0}: Error finding container d60876f1bcb1725e04e3a0dcb7adfe15bafbba8cea741090fa6bb1cda6758f51: Status 404 returned error can't find the container with id d60876f1bcb1725e04e3a0dcb7adfe15bafbba8cea741090fa6bb1cda6758f51 Jul 01 16:28:39.168854 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.168822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" Jul 01 16:28:39.178106 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.178071 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22124612_6bae_48e5_ad05_ddc1650ceeac.slice/crio-758fe178017d2c3c94fbbe85eb958a57406915bb6abce89d6d044db4eb0e0f73 WatchSource:0}: Error finding container 758fe178017d2c3c94fbbe85eb958a57406915bb6abce89d6d044db4eb0e0f73: Status 404 returned error can't find the container with id 758fe178017d2c3c94fbbe85eb958a57406915bb6abce89d6d044db4eb0e0f73 Jul 01 16:28:39.187576 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.187539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcxk7" Jul 01 16:28:39.195145 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.195121 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182bc735_1743_4a07_9fa7_5289de42e45f.slice/crio-d925054aa54d9a0601d5d6b574d9cec5863e662637e6a082bdd62277a129e46d WatchSource:0}: Error finding container d925054aa54d9a0601d5d6b574d9cec5863e662637e6a082bdd62277a129e46d: Status 404 returned error can't find the container with id d925054aa54d9a0601d5d6b574d9cec5863e662637e6a082bdd62277a129e46d Jul 01 16:28:39.212020 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.211985 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkdhb" Jul 01 16:28:39.216772 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.216752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:28:39.220845 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.220811 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66420fd_91fb_4735_b34c_fde305faf93b.slice/crio-63cb1175bc48cee84ddabbb397bf4012dcbbe6ef3fa3c3f4372fa278d2ac9ceb WatchSource:0}: Error finding container 63cb1175bc48cee84ddabbb397bf4012dcbbe6ef3fa3c3f4372fa278d2ac9ceb: Status 404 returned error can't find the container with id 63cb1175bc48cee84ddabbb397bf4012dcbbe6ef3fa3c3f4372fa278d2ac9ceb Jul 01 16:28:39.225272 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:28:39.225247 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb59440d_ebeb_4a5a_a88c_1a14bdfe0875.slice/crio-8865bdecea9bc4a5a54f7d0565d1dc4c8441fdd07810ff12ae6b25c093fcd53d WatchSource:0}: Error finding container 8865bdecea9bc4a5a54f7d0565d1dc4c8441fdd07810ff12ae6b25c093fcd53d: Status 404 returned error can't find the container with id 8865bdecea9bc4a5a54f7d0565d1dc4c8441fdd07810ff12ae6b25c093fcd53d Jul 01 16:28:39.227116 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.227096 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-dm4ck_openshift-ovn-kubernetes(db59440d-ebeb-4a5a-a88c-1a14bdfe0875): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 01 16:28:39.228528 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.228509 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-dm4ck_openshift-ovn-kubernetes(db59440d-ebeb-4a5a-a88c-1a14bdfe0875): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 01 16:28:39.231679 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.231631 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6e77c9b2c23b8fc598ee5d64c9df35d8d108cf86486eee1d53a4b727e01b7960\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" podUID="db59440d-ebeb-4a5a-a88c-1a14bdfe0875" Jul 01 16:28:39.382395 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.382308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:39.382557 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.382461 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:39.382557 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.382539 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:40.382522503 +0000 UTC m=+2.958214773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:39.482634 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.482604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:39.482813 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.482642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:39.482813 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.482787 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:28:39.482908 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.482813 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:28:39.482908 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.482830 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:39.482908 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.482791 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:39.482908 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.482898 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:40.482878945 +0000 UTC m=+3.058571237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:39.483055 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.482920 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:28:40.482909338 +0000 UTC m=+3.058601614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:39.814462 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.814314 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:23:39 +0000 UTC" deadline="2028-01-22 17:30:38.311756926 +0000 UTC" Jul 01 16:28:39.814462 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.814392 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13681h1m58.497368961s" Jul 01 16:28:39.852536 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.852508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:39.852724 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.852661 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:39.853716 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.853656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"8865bdecea9bc4a5a54f7d0565d1dc4c8441fdd07810ff12ae6b25c093fcd53d"} Jul 01 16:28:39.855102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.855058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkdhb" event={"ID":"c66420fd-91fb-4735-b34c-fde305faf93b","Type":"ContainerStarted","Data":"63cb1175bc48cee84ddabbb397bf4012dcbbe6ef3fa3c3f4372fa278d2ac9ceb"} Jul 01 16:28:39.856562 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.856389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerStarted","Data":"758fe178017d2c3c94fbbe85eb958a57406915bb6abce89d6d044db4eb0e0f73"} Jul 01 16:28:39.857595 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.857576 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8k45g" event={"ID":"4809f2d1-90dc-4499-9559-d31551ade25c","Type":"ContainerStarted","Data":"532dea358f6fa1e32056862646cc790e6692d66b3bf277961d386aaf01af552d"} Jul 01 16:28:39.859163 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.859058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" event={"ID":"2bc69076-97c2-4ed2-87c2-3c19592dc1ee","Type":"ContainerStarted","Data":"5686473ea4a8f8ead8c3f3465d84ad74d0d87c51458971b6e7c4ce7985ef809e"} Jul 01 16:28:39.860402 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.860376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" event={"ID":"0325fca5-0779-4946-be6e-63eaae5120ce","Type":"ContainerStarted","Data":"f6539941013a7fc068a4d1bbf5601f8031d22c04072fc2a82d58a350cca9365e"} Jul 01 16:28:39.861354 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:39.861282 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6e77c9b2c23b8fc598ee5d64c9df35d8d108cf86486eee1d53a4b727e01b7960\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6e77c9b2c23b8fc598ee5d64c9df35d8d108cf86486eee1d53a4b727e01b7960\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f42d9801082693086c3f18680db25db2fe354f33e1935fd14227db3ca334d1\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" podUID="db59440d-ebeb-4a5a-a88c-1a14bdfe0875" Jul 01 16:28:39.861514 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.861462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"4df39c04828e5e87c04098085e7c6ee6","Type":"ContainerStarted","Data":"b7c358d9b521627e32403dc1239e9d39f4f41a0f4eb3340865707ef5f988b820"} Jul 01 16:28:39.862714 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.862674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" event={"ID":"9780f0e5ad59932d715562fcbe9c29d6","Type":"ContainerStarted","Data":"b47a81bf8189169b1a86e3009b359ce836617a8fa31e1adca0390e515701231f"} Jul 01 16:28:39.863925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.863905 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcxk7" event={"ID":"182bc735-1743-4a07-9fa7-5289de42e45f","Type":"ContainerStarted","Data":"d925054aa54d9a0601d5d6b574d9cec5863e662637e6a082bdd62277a129e46d"} Jul 01 16:28:39.865104 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.865080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gsxd" event={"ID":"c151de77-21a2-46bf-b289-3bed524e8a56","Type":"ContainerStarted","Data":"d60876f1bcb1725e04e3a0dcb7adfe15bafbba8cea741090fa6bb1cda6758f51"} Jul 01 16:28:39.866248 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.866226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d42pq" event={"ID":"c54ccd70-1122-45ee-bd23-12c3535cfe86","Type":"ContainerStarted","Data":"72f15bc7d097a9fcef20f6daab0c9c06c745c34a4007155a163556ff51bc394f"} Jul 01 16:28:39.947256 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:39.947201 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:28:40.391886 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.391799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:40.392104 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.391995 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:40.392104 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.392080 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:42.392057671 +0000 UTC m=+4.967749952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:40.492831 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.492787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:40.493040 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.492856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:40.493114 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.493044 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:40.493388 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.493115 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:28:42.493096371 +0000 UTC m=+5.068788643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:40.493533 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.493510 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:28:40.493636 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.493539 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:28:40.493636 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.493574 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:40.493636 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.493629 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:42.493610524 +0000 UTC m=+5.069302793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:40.815290 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.815156 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:23:39 +0000 UTC" deadline="2028-01-08 08:49:38.368431055 +0000 UTC" Jul 01 16:28:40.815290 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.815236 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13336h20m57.553199827s" Jul 01 16:28:40.849041 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.849000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:40.849234 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.849149 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:40.849234 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:40.849199 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:40.849389 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:40.849335 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:41.851977 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:41.851512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:41.851977 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:41.851907 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:42.412733 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:42.412026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:42.412733 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.412232 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:42.412733 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.412307 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:46.412286577 +0000 UTC m=+8.987978867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:42.512792 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:42.512748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:42.512971 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:42.512811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:42.512971 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.512952 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:42.513114 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.513031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:28:46.513001098 +0000 UTC m=+9.088693371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:42.513638 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.513574 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:28:42.513638 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.513607 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:28:42.513638 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.513622 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:42.513858 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.513662 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:46.513650658 +0000 UTC m=+9.089342928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:42.848877 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:42.848786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:42.849060 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.848922 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:42.849060 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:42.848992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:42.849186 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:42.849082 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:43.849180 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:43.848672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:43.849180 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:43.848831 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:44.848671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:44.848636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:44.848671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:44.848660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:44.848949 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:44.848770 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:44.849025 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:44.848998 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:45.851334 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:45.851294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:45.851842 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:45.851442 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:46.446831 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:46.446792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:46.447020 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.446974 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:46.447106 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.447057 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:54.447034684 +0000 UTC m=+17.022726978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:46.547725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:46.547686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:46.547911 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:46.547737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:46.547911 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.547877 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:46.548021 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.547937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:28:54.547919323 +0000 UTC m=+17.123611614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:46.548330 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.548310 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:28:46.548330 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.548332 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:28:46.548517 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.548342 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:46.548517 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.548376 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:28:54.548366266 +0000 UTC m=+17.124058547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:46.849439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:46.849364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:46.849439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:46.849390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:46.849682 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.849501 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:46.849682 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:46.849608 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:47.848967 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:47.848937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:47.849396 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:47.849034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:48.849397 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:48.849353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:48.849887 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:48.849353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:48.849887 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:48.849527 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:48.849887 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:48.849593 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:49.848671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:49.848636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:49.848831 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:49.848781 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:50.848900 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:50.848866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:50.849354 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:50.848866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:50.849354 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:50.849003 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:50.849471 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:50.849442 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:51.848611 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:51.848574 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:51.848811 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:51.848726 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:52.849037 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:52.848584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:52.849037 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:52.848619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:52.849037 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:52.848697 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:52.849037 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:52.849006 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:52.897024 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:52.896990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" event={"ID":"9780f0e5ad59932d715562fcbe9c29d6","Type":"ContainerStarted","Data":"77d9d571a0704878ab75085b1eeb2048d05be8311ea97c308a02d0e33bda9bd4"} Jul 01 16:28:52.900279 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:52.900253 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" event={"ID":"2bc69076-97c2-4ed2-87c2-3c19592dc1ee","Type":"ContainerStarted","Data":"ac2277364e6710d684a6ec4d0974f93fbd9c1fd77e1e152c48a2966453864bc6"} Jul 01 16:28:52.909962 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:52.909918 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-32.ec2.internal" podStartSLOduration=13.909899048 podStartE2EDuration="13.909899048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:52.909549432 +0000 UTC m=+15.485241721" watchObservedRunningTime="2026-07-01 16:28:52.909899048 +0000 UTC m=+15.485591339" Jul 01 16:28:52.925135 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:52.925086 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hkhmw" podStartSLOduration=1.596534253 podStartE2EDuration="14.925067064s" totalImagesPullingTime="13.328532811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:52.92489529 +0000 UTC m=+15.500587580" watchObservedRunningTime="2026-07-01 16:28:52.925067064 +0000 UTC m=+15.500759354" Jul 01 16:28:53.850720 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.850690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:53.851171 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:53.850815 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:53.904566 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.904525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerStarted","Data":"a8aaafd5898e8ee4844af0f27c25fdc09923bf45d3fa57ec922151343b8aed85"} Jul 01 16:28:53.907311 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.907234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8k45g" event={"ID":"4809f2d1-90dc-4499-9559-d31551ade25c","Type":"ContainerStarted","Data":"1c37fbfe72bac58ad9d381b260b1043dcfeda00c8b5e5b2bc908e49f1874a7eb"} Jul 01 16:28:53.921284 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.921254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcxk7" event={"ID":"182bc735-1743-4a07-9fa7-5289de42e45f","Type":"ContainerStarted","Data":"10bee86593e1b4b4f366c00f262be8e9d8f8f81a5ec8e43d327a0eb2ff92ea0e"} Jul 01 16:28:53.923794 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.923760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gsxd" event={"ID":"c151de77-21a2-46bf-b289-3bed524e8a56","Type":"ContainerStarted","Data":"e4a23b9fff47d129fa0d52e42ee4da9003ca501d0971474ca3c596826e89157e"} Jul 01 16:28:53.927037 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.926617 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d42pq" event={"ID":"c54ccd70-1122-45ee-bd23-12c3535cfe86","Type":"ContainerStarted","Data":"25ba8d701b75b31744889c2421d86af85ee4e9806686a09697d237c805c15656"} Jul 01 16:28:53.951465 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.950540 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hcxk7" podStartSLOduration=2.341526637 podStartE2EDuration="15.950520663s" totalImagesPullingTime="13.608994026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:53.950106259 +0000 UTC m=+16.525798584" watchObservedRunningTime="2026-07-01 16:28:53.950520663 +0000 UTC m=+16.526212955" Jul 01 16:28:53.982164 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.982112 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8k45g" podStartSLOduration=6.457466936 podStartE2EDuration="15.982095476s" totalImagesPullingTime="9.52462854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:53.967614647 +0000 UTC m=+16.543306940" watchObservedRunningTime="2026-07-01 16:28:53.982095476 +0000 UTC m=+16.557787765" Jul 01 16:28:53.982337 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.982316 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4gsxd" podStartSLOduration=2.711351194 podStartE2EDuration="15.982309496s" totalImagesPullingTime="13.270958302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:53.981665124 +0000 UTC m=+16.557357415" watchObservedRunningTime="2026-07-01 16:28:53.982309496 +0000 UTC m=+16.558001786" Jul 01 16:28:53.996415 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:53.996354 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d42pq" podStartSLOduration=2.7079087509999997 podStartE2EDuration="15.996330828s" totalImagesPullingTime="13.288422077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:53.995540898 +0000 UTC m=+16.571233187" watchObservedRunningTime="2026-07-01 16:28:53.996330828 +0000 UTC m=+16.572023119" Jul 01 16:28:54.510402 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.510359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:54.510595 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.510540 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:54.510660 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.510608 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:10.510590898 +0000 UTC m=+33.086283167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:28:54.610938 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.610908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:54.611129 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.610956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:54.611129 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.611083 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:54.611198 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.611138 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:29:10.611123981 +0000 UTC m=+33.186816249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:28:54.611560 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.611515 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:28:54.611560 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.611543 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:28:54.611560 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.611554 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:54.611724 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.611604 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:10.611588025 +0000 UTC m=+33.187280295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:28:54.849378 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.849297 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:54.849570 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.849434 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:54.849913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.849891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:54.850026 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:54.849983 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:54.930231 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.930201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" event={"ID":"0325fca5-0779-4946-be6e-63eaae5120ce","Type":"ContainerStarted","Data":"9d1b3c34d81eb4be01a5d211fd8486b0dcd92164e74428d837ecb9c3123da086"} Jul 01 16:28:54.932141 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.932108 2562 generic.go:356] "Generic (PLEG): container finished" podID="4df39c04828e5e87c04098085e7c6ee6" containerID="65d3d2dec9136303551e4d39d028dd8a38d69a10bb2d6d67d84126d9bdf0d1b6" exitCode=0 Jul 01 16:28:54.932266 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.932196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"4df39c04828e5e87c04098085e7c6ee6","Type":"ContainerDied","Data":"65d3d2dec9136303551e4d39d028dd8a38d69a10bb2d6d67d84126d9bdf0d1b6"} Jul 01 16:28:54.934040 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.934010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkdhb" event={"ID":"c66420fd-91fb-4735-b34c-fde305faf93b","Type":"ContainerStarted","Data":"8d71c47965d2be7a4ab06edee294fae77d39f14195995ba323ed0f4861f764a6"} Jul 01 16:28:54.935850 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.935825 2562 generic.go:356] "Generic (PLEG): container finished" podID="22124612-6bae-48e5-ad05-ddc1650ceeac" containerID="a8aaafd5898e8ee4844af0f27c25fdc09923bf45d3fa57ec922151343b8aed85" exitCode=0 Jul 01 16:28:54.935959 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.935927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerDied","Data":"a8aaafd5898e8ee4844af0f27c25fdc09923bf45d3fa57ec922151343b8aed85"} Jul 01 16:28:54.983142 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:54.983088 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kkdhb" podStartSLOduration=3.769986937 podStartE2EDuration="16.983068903s" totalImagesPullingTime="13.213081966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:54.982778211 +0000 UTC m=+17.558470522" watchObservedRunningTime="2026-07-01 16:28:54.983068903 +0000 UTC m=+17.558761192" Jul 01 16:28:55.506706 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.506460 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:28:55.849139 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.849056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:55.849300 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:55.849189 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:55.851391 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.851240 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:28:55.506703067Z","UUID":"24388423-1c60-47e1-8b5c-53396c52ab3a","Handler":null,"Name":"","Endpoint":""} Jul 01 16:28:55.853791 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.853751 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:28:55.853928 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.853799 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:28:55.940130 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.940089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" event={"ID":"0325fca5-0779-4946-be6e-63eaae5120ce","Type":"ContainerStarted","Data":"b2cbcb3d523207d69d8e4dda910a787641f5ccf6410a467935ac6cc809bedfc5"} Jul 01 16:28:55.942091 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.942062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" event={"ID":"4df39c04828e5e87c04098085e7c6ee6","Type":"ContainerStarted","Data":"8d552b78acabbdeda9164b48c549d740416f033eb39d5e9f2c77da2c12e96a74"} Jul 01 16:28:55.958718 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:55.958660 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-32.ec2.internal" podStartSLOduration=16.958638960000002 podStartE2EDuration="16.95863896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:55.957881372 +0000 UTC m=+18.533573663" watchObservedRunningTime="2026-07-01 16:28:55.95863896 +0000 UTC m=+18.534331253" Jul 01 16:28:56.849119 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:56.849084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:56.849119 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:56.849116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:56.849377 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:56.849220 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:56.849377 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:56.849346 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:57.849797 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:57.849764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:57.850222 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:57.849874 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:28:57.950659 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:57.950619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" event={"ID":"0325fca5-0779-4946-be6e-63eaae5120ce","Type":"ContainerStarted","Data":"3504107face3d1beb644ac1efc9446921e60663b583e3e11504a227d47a9d4d3"} Jul 01 16:28:57.968327 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:57.968274 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vbsr8" podStartSLOduration=3.450816597 podStartE2EDuration="19.968253633s" totalImagesPullingTime="16.517437036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:28:57.967571636 +0000 UTC m=+20.543263928" watchObservedRunningTime="2026-07-01 16:28:57.968253633 +0000 UTC m=+20.543945923" Jul 01 16:28:58.674838 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:58.674809 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:58.675532 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:58.675471 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:58.849271 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:58.849222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:28:58.849458 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:58.849250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:28:58.849458 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:58.849376 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:28:58.849608 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:58.849459 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:28:58.953985 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:58.953909 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:58.954417 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:58.954390 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4gsxd" Jul 01 16:28:59.848943 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:28:59.848903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:28:59.849125 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:28:59.849042 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:00.848792 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:00.848758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:00.849431 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:00.848882 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:00.849431 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:00.848919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:00.849431 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:00.848980 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:01.848537 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:01.848467 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:01.848735 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:01.848662 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:02.849180 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:02.849138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:02.849669 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:02.849280 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:02.849725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:02.849700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:02.849804 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:02.849782 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:03.848594 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:03.848563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:03.848782 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:03.848678 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:04.849143 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:04.849107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:04.849546 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:04.849115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:04.849546 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:04.849210 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:04.849546 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:04.849297 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:05.849250 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.849211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:05.849887 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:05.849359 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:05.969879 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.969809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:29:05.970129 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970108 2562 generic.go:356] "Generic (PLEG): container finished" podID="db59440d-ebeb-4a5a-a88c-1a14bdfe0875" containerID="3a91e92facd935ebd776209eb5d9d2129b97c2ef10fe9e55ced81361b9949de8" exitCode=1 Jul 01 16:29:05.970203 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"29cd442136c783d17edc484a336b869f8817a209817741d9c99ee47fea3f9420"} Jul 01 16:29:05.970260 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"a3f4ac0a1f9ea370aacd6cf39a28ada67454194679e8c3a2df98cf51a4e48711"} Jul 01 16:29:05.970314 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"34dd6cf691d73a0ee2e9219aa306462578da86053516f49ead8dc7fb62260237"} Jul 01 16:29:05.970374 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"186668903a2e5e8af8aa6c3c64fea8b85b5bdf0beb023d93bd7a15ac66326b98"} Jul 01 16:29:05.970374 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerDied","Data":"3a91e92facd935ebd776209eb5d9d2129b97c2ef10fe9e55ced81361b9949de8"} Jul 01 16:29:05.970456 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.970389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"2518da9df26dca29ba3ca944dddb216a80584d4c7aeefd7be934e8edb2f5c83a"} Jul 01 16:29:05.971815 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.971793 2562 generic.go:356] "Generic (PLEG): container finished" podID="22124612-6bae-48e5-ad05-ddc1650ceeac" containerID="c543add08b7300ddbb680298811a3105bf1e371fdc36c6f6238642f0944abdc1" exitCode=0 Jul 01 16:29:05.971928 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:05.971845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerDied","Data":"c543add08b7300ddbb680298811a3105bf1e371fdc36c6f6238642f0944abdc1"} Jul 01 16:29:06.848681 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:06.848647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:06.848824 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:06.848647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:06.848824 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:06.848759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:06.848908 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:06.848829 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:07.849263 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:07.849239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:07.849788 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:07.849334 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:07.979709 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:07.979680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:29:07.980119 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:07.980079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"2af039665e343285f5f433e65429206fbbc794f48ed85044ff6507b8a70a9164"} Jul 01 16:29:07.982120 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:07.982096 2562 generic.go:356] "Generic (PLEG): container finished" podID="22124612-6bae-48e5-ad05-ddc1650ceeac" containerID="3c8b76b62accfe4e16f066c5d01ce5fb7e491a0ddc26fe3c22e1d3a275e5895f" exitCode=0 Jul 01 16:29:07.982221 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:07.982145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerDied","Data":"3c8b76b62accfe4e16f066c5d01ce5fb7e491a0ddc26fe3c22e1d3a275e5895f"} Jul 01 16:29:08.849047 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:08.849009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:08.849047 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:08.849047 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:08.849272 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:08.849141 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:08.849272 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:08.849220 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:09.848407 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:09.848372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:09.848606 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:09.848498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:09.989028 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:09.988880 2562 generic.go:356] "Generic (PLEG): container finished" podID="22124612-6bae-48e5-ad05-ddc1650ceeac" containerID="acbc4ccea874b28b07592a5132df52c9401da16ced2f1ea232e528acba6c5fb6" exitCode=0 Jul 01 16:29:09.989028 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:09.988960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerDied","Data":"acbc4ccea874b28b07592a5132df52c9401da16ced2f1ea232e528acba6c5fb6"} Jul 01 16:29:10.529390 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.529356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:10.529597 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.529509 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:29:10.529597 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.529574 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret podName:6ea1111c-e0ea-45e1-a29b-aaccc6fbc154 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:42.52955716 +0000 UTC m=+65.105249429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret") pod "global-pull-secret-syncer-tgx29" (UID: "6ea1111c-e0ea-45e1-a29b-aaccc6fbc154") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:29:10.630703 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.630651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:10.630703 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.630706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:10.630947 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.630845 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:29:10.630947 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.630876 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:29:10.630947 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.630847 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:29:10.630947 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.630889 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kxf4w for pod openshift-network-diagnostics/network-check-target-l64q8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:29:10.630947 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.630944 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:29:42.630924718 +0000 UTC m=+65.206616987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:29:10.631126 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.630962 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w podName:11537f17-066d-4033-ac9b-b702d77dcbe4 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:42.630954736 +0000 UTC m=+65.206647004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxf4w" (UniqueName: "kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w") pod "network-check-target-l64q8" (UID: "11537f17-066d-4033-ac9b-b702d77dcbe4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:29:10.848769 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.848529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:10.848769 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.848531 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:10.848769 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.848672 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:10.848769 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:10.848749 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:10.996007 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.995976 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:29:10.996414 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.996384 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"0aca260be5e75ba2b3d907d82a620ffc31e69d7a69ae2ed0db4cd2d743a12a97"} Jul 01 16:29:10.996805 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.996683 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:29:10.996805 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.996752 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:29:10.996953 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:10.996890 2562 scope.go:117] "RemoveContainer" containerID="3a91e92facd935ebd776209eb5d9d2129b97c2ef10fe9e55ced81361b9949de8" Jul 01 16:29:11.017496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.017456 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:29:11.852488 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.852443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:11.852720 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:11.852687 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:11.977971 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.977935 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgx29"] Jul 01 16:29:11.981032 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.980296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l64q8"] Jul 01 16:29:11.981032 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.980546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:11.981032 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:11.980653 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:11.981032 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.980944 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5vvh"] Jul 01 16:29:11.981348 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:11.981058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:11.981348 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:11.981160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:12.003732 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:12.003691 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:29:12.004157 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:12.004093 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" event={"ID":"db59440d-ebeb-4a5a-a88c-1a14bdfe0875","Type":"ContainerStarted","Data":"7de86aa347a586a99d4b0465d007bac911602531ebeb52278cc27ed143081538"} Jul 01 16:29:12.004230 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:12.004183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:12.004312 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:12.004288 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:12.004685 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:12.004602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:29:12.025746 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:12.025670 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:29:12.036941 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:12.036863 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" podStartSLOduration=8.134195649 podStartE2EDuration="34.036842003s" totalImagesPullingTime="25.902646354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-07-01 16:29:12.036549606 +0000 UTC m=+34.612241918" watchObservedRunningTime="2026-07-01 16:29:12.036842003 +0000 UTC m=+34.612534296" Jul 01 16:29:13.852010 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:13.851947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:13.852010 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:13.851981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:13.852556 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:13.852068 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:13.852556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:13.852130 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:13.852556 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:13.852259 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:13.852556 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:13.852353 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:15.014082 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:15.014048 2562 generic.go:356] "Generic (PLEG): container finished" podID="22124612-6bae-48e5-ad05-ddc1650ceeac" containerID="417a7f5ab4152cc587adc8443d3da1a7db2a19133625be9bd2d3df2a51b542a3" exitCode=0 Jul 01 16:29:15.014729 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:15.014091 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerDied","Data":"417a7f5ab4152cc587adc8443d3da1a7db2a19133625be9bd2d3df2a51b542a3"} Jul 01 16:29:15.851533 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:15.851505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:15.851704 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:15.851597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:15.851704 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:15.851601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l64q8" podUID="11537f17-066d-4033-ac9b-b702d77dcbe4" Jul 01 16:29:15.851704 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:15.851604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:15.851704 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:15.851684 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgx29" podUID="6ea1111c-e0ea-45e1-a29b-aaccc6fbc154" Jul 01 16:29:15.851834 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:15.851760 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:29:16.020139 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:16.020108 2562 generic.go:356] "Generic (PLEG): container finished" podID="22124612-6bae-48e5-ad05-ddc1650ceeac" containerID="5a346719b5e730254677f968db0804149a89005fa24e312720fee0484e0f5bb0" exitCode=0 Jul 01 16:29:16.020637 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:16.020156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerDied","Data":"5a346719b5e730254677f968db0804149a89005fa24e312720fee0484e0f5bb0"} Jul 01 16:29:17.026249 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.026063 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" event={"ID":"22124612-6bae-48e5-ad05-ddc1650ceeac","Type":"ContainerStarted","Data":"c792949845c6e9fbebab2e56db1d7f9d68238f061f3b1fc8b3373b8f82ee2b4a"} Jul 01 16:29:17.029939 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.029909 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:17.049014 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.048961 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cdnk5" podStartSLOduration=13.082564405 podStartE2EDuration="39.048945077s" totalImagesPullingTime="25.966380672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:29:17.048766936 +0000 UTC m=+39.624459227" watchObservedRunningTime="2026-07-01 16:29:17.048945077 +0000 UTC m=+39.624637367" Jul 01 16:29:17.110567 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.110533 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:17.199467 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.199432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:17.254406 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.254368 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:17.665744 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.665693 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:17.714374 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.714343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:17.781115 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.781085 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-32.ec2.internal" event="NodeReady" Jul 01 16:29:17.781269 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.781242 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:29:17.829187 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.829157 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-757ql"] Jul 01 16:29:17.842093 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.842062 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqxxd"] Jul 01 16:29:17.842274 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.842249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-757ql" Jul 01 16:29:17.845228 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.845202 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:29:17.845355 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.845208 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:29:17.845355 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.845263 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2lss\"" Jul 01 16:29:17.852132 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.852110 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:17.854636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.854614 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:29:17.854837 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.854823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.855326 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zq8q2\"" Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.855789 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.856546 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-757ql"] Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.856656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqxxd"] Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.856783 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.857109 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:17.858409 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.857446 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:17.859752 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.859733 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:29:17.859851 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.859804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:29:17.859851 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.859812 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zg86h\"" Jul 01 16:29:17.860848 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.860830 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:29:17.860939 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.860891 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:29:17.860939 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.860914 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jf2dq\"" Jul 01 16:29:17.985866 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.985825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf5670e-8038-4292-99c6-5a1e6f802583-tmp-dir\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:17.985866 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.985870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:17.986212 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.985912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxvjm\" (UniqueName: \"kubernetes.io/projected/1cf5670e-8038-4292-99c6-5a1e6f802583-kube-api-access-sxvjm\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:17.986212 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.985940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96aa6e7-359b-4778-bbb5-a255b3418abe-cert\") pod \"ingress-canary-mqxxd\" (UID: \"e96aa6e7-359b-4778-bbb5-a255b3418abe\") " pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:17.986212 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.985982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cf5670e-8038-4292-99c6-5a1e6f802583-config-volume\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:17.986212 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:17.986024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhh75\" (UniqueName: \"kubernetes.io/projected/e96aa6e7-359b-4778-bbb5-a255b3418abe-kube-api-access-vhh75\") pod \"ingress-canary-mqxxd\" (UID: \"e96aa6e7-359b-4778-bbb5-a255b3418abe\") " pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:18.087280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhh75\" (UniqueName: \"kubernetes.io/projected/e96aa6e7-359b-4778-bbb5-a255b3418abe-kube-api-access-vhh75\") pod \"ingress-canary-mqxxd\" (UID: \"e96aa6e7-359b-4778-bbb5-a255b3418abe\") " pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf5670e-8038-4292-99c6-5a1e6f802583-tmp-dir\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:18.087462 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxvjm\" (UniqueName: \"kubernetes.io/projected/1cf5670e-8038-4292-99c6-5a1e6f802583-kube-api-access-sxvjm\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:18.087553 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:18.587535425 +0000 UTC m=+41.163227729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96aa6e7-359b-4778-bbb5-a255b3418abe-cert\") pod \"ingress-canary-mqxxd\" (UID: \"e96aa6e7-359b-4778-bbb5-a255b3418abe\") " pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:18.087708 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cf5670e-8038-4292-99c6-5a1e6f802583-config-volume\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.087953 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.087758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf5670e-8038-4292-99c6-5a1e6f802583-tmp-dir\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.088171 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.088152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cf5670e-8038-4292-99c6-5a1e6f802583-config-volume\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.092044 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.092021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e96aa6e7-359b-4778-bbb5-a255b3418abe-cert\") pod \"ingress-canary-mqxxd\" (UID: \"e96aa6e7-359b-4778-bbb5-a255b3418abe\") " pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:18.095983 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.095954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxvjm\" (UniqueName: \"kubernetes.io/projected/1cf5670e-8038-4292-99c6-5a1e6f802583-kube-api-access-sxvjm\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.096136 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.096120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhh75\" (UniqueName: \"kubernetes.io/projected/e96aa6e7-359b-4778-bbb5-a255b3418abe-kube-api-access-vhh75\") pod \"ingress-canary-mqxxd\" (UID: \"e96aa6e7-359b-4778-bbb5-a255b3418abe\") " pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:18.166210 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.166125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqxxd" Jul 01 16:29:18.361851 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.361820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqxxd"] Jul 01 16:29:18.366162 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:29:18.366132 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96aa6e7_359b_4778_bbb5_a255b3418abe.slice/crio-414b60ddd21e849e553231d403ab3ad1eb8b3111b70d2fe03790de3d841601d0 WatchSource:0}: Error finding container 414b60ddd21e849e553231d403ab3ad1eb8b3111b70d2fe03790de3d841601d0: Status 404 returned error can't find the container with id 414b60ddd21e849e553231d403ab3ad1eb8b3111b70d2fe03790de3d841601d0 Jul 01 16:29:18.591246 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:18.591210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:18.591429 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:18.591339 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:18.591429 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:18.591393 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:19.591379983 +0000 UTC m=+42.167072252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:19.032050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:19.032017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqxxd" event={"ID":"e96aa6e7-359b-4778-bbb5-a255b3418abe","Type":"ContainerStarted","Data":"414b60ddd21e849e553231d403ab3ad1eb8b3111b70d2fe03790de3d841601d0"} Jul 01 16:29:19.600915 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:19.600874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:19.601341 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:19.601026 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:19.601341 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:19.601103 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:21.601088678 +0000 UTC m=+44.176780945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:21.261537 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:21.261339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:21.614147 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:21.614106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:21.614332 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:21.614250 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:21.614332 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:21.614307 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:25.614293151 +0000 UTC m=+48.189985419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:22.303205 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:22.303159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:22.455948 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:22.455896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:22.558059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:22.557977 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:23.042676 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:23.042642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqxxd" event={"ID":"e96aa6e7-359b-4778-bbb5-a255b3418abe","Type":"ContainerStarted","Data":"6d7902ab60af35e6839054681fad2a9166e4c9084fe686c0e5bcf6685baf8293"} Jul 01 16:29:23.057721 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:23.057670 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqxxd" podStartSLOduration=1.844044233 podStartE2EDuration="6.057654288s" totalImagesPullingTime="4.213610055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:29:23.057004877 +0000 UTC m=+45.632697168" watchObservedRunningTime="2026-07-01 16:29:23.057654288 +0000 UTC m=+45.633346578" Jul 01 16:29:25.639301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:25.639262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:25.640149 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:25.639441 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:25.640149 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:25.639545 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:33.639524995 +0000 UTC m=+56.215217282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:26.011100 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:26.011064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:26.066880 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:26.066844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:27.503239 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.503206 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx"] Jul 01 16:29:27.504731 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.504715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.507591 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.507561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 16:29:27.509195 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.509164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 16:29:27.509356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.509331 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 16:29:27.509623 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.509439 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 16:29:27.515369 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.515349 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx"] Jul 01 16:29:27.652236 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.652192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tg4w\" (UniqueName: \"kubernetes.io/projected/24621ea3-50ce-4c35-a4a4-87fe0b950a08-kube-api-access-6tg4w\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.652440 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.652329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24621ea3-50ce-4c35-a4a4-87fe0b950a08-tmp\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.652440 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.652381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/24621ea3-50ce-4c35-a4a4-87fe0b950a08-klusterlet-config\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.753118 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.753087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tg4w\" (UniqueName: \"kubernetes.io/projected/24621ea3-50ce-4c35-a4a4-87fe0b950a08-kube-api-access-6tg4w\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.753204 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.753166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24621ea3-50ce-4c35-a4a4-87fe0b950a08-tmp\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.753204 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.753196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/24621ea3-50ce-4c35-a4a4-87fe0b950a08-klusterlet-config\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.753692 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.753646 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24621ea3-50ce-4c35-a4a4-87fe0b950a08-tmp\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.757153 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.757129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/24621ea3-50ce-4c35-a4a4-87fe0b950a08-klusterlet-config\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.761670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.761642 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tg4w\" (UniqueName: \"kubernetes.io/projected/24621ea3-50ce-4c35-a4a4-87fe0b950a08-kube-api-access-6tg4w\") pod \"klusterlet-addon-workmgr-544ff89d76-sp6cx\" (UID: \"24621ea3-50ce-4c35-a4a4-87fe0b950a08\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.817150 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.817118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:27.945343 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:27.945318 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx"] Jul 01 16:29:27.947716 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:29:27.947678 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24621ea3_50ce_4c35_a4a4_87fe0b950a08.slice/crio-8fc718705ed738b6207d26b4a94ca51fe2dcf5c619093cd1aeb450d42940e775 WatchSource:0}: Error finding container 8fc718705ed738b6207d26b4a94ca51fe2dcf5c619093cd1aeb450d42940e775: Status 404 returned error can't find the container with id 8fc718705ed738b6207d26b4a94ca51fe2dcf5c619093cd1aeb450d42940e775 Jul 01 16:29:28.056817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:28.056734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" event={"ID":"24621ea3-50ce-4c35-a4a4-87fe0b950a08","Type":"ContainerStarted","Data":"8fc718705ed738b6207d26b4a94ca51fe2dcf5c619093cd1aeb450d42940e775"} Jul 01 16:29:32.069018 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:32.068976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" event={"ID":"24621ea3-50ce-4c35-a4a4-87fe0b950a08","Type":"ContainerStarted","Data":"799be49ef6744e6a7119395084eae72ba9a8f63d8b12a064dab92f3c6f0bd447"} Jul 01 16:29:32.069554 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:32.069197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:32.070970 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:32.070946 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:29:32.084888 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:32.084842 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" podStartSLOduration=1.362783693 podStartE2EDuration="5.084827981s" totalImagesPullingTime="3.722044288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:29:32.084323783 +0000 UTC m=+54.660016073" watchObservedRunningTime="2026-07-01 16:29:32.084827981 +0000 UTC m=+54.660520271" Jul 01 16:29:33.715546 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:33.715504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:33.715998 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:33.715641 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:33.715998 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:33.715707 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:29:49.715691011 +0000 UTC m=+72.291383279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:37.991510 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:37.991434 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:38.068937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:38.068899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:42.573021 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.572964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:42.576241 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.576220 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:29:42.585936 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.585909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ea1111c-e0ea-45e1-a29b-aaccc6fbc154-original-pull-secret\") pod \"global-pull-secret-syncer-tgx29\" (UID: \"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154\") " pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:42.674324 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.674276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:42.674324 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.674335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:29:42.677029 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.677005 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:29:42.677096 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.677027 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:29:42.685367 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:42.685341 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 16:29:42.685455 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:42.685417 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:30:46.685394752 +0000 UTC m=+129.261087028 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : secret "metrics-daemon-secret" not found Jul 01 16:29:42.687623 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.687604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:29:42.698081 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.698061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxf4w\" (UniqueName: \"kubernetes.io/projected/11537f17-066d-4033-ac9b-b702d77dcbe4-kube-api-access-kxf4w\") pod \"network-check-target-l64q8\" (UID: \"11537f17-066d-4033-ac9b-b702d77dcbe4\") " pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:42.774243 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.774207 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zg86h\"" Jul 01 16:29:42.782433 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.782412 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:42.782559 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.782511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgx29" Jul 01 16:29:42.921852 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.921819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l64q8"] Jul 01 16:29:42.925113 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:29:42.925084 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11537f17_066d_4033_ac9b_b702d77dcbe4.slice/crio-dea8b9ca93bee96e81a6263cf71786d557391a4f6dd266c1ae78f077018ed2fd WatchSource:0}: Error finding container dea8b9ca93bee96e81a6263cf71786d557391a4f6dd266c1ae78f077018ed2fd: Status 404 returned error can't find the container with id dea8b9ca93bee96e81a6263cf71786d557391a4f6dd266c1ae78f077018ed2fd Jul 01 16:29:42.933756 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:42.933643 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgx29"] Jul 01 16:29:42.935956 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:29:42.935936 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea1111c_e0ea_45e1_a29b_aaccc6fbc154.slice/crio-5706aa6f354a0cb7154b22986d890ba287d527e037bdfd45230d1d9e05c48d44 WatchSource:0}: Error finding container 5706aa6f354a0cb7154b22986d890ba287d527e037bdfd45230d1d9e05c48d44: Status 404 returned error can't find the container with id 5706aa6f354a0cb7154b22986d890ba287d527e037bdfd45230d1d9e05c48d44 Jul 01 16:29:43.093594 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:43.093500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l64q8" event={"ID":"11537f17-066d-4033-ac9b-b702d77dcbe4","Type":"ContainerStarted","Data":"dea8b9ca93bee96e81a6263cf71786d557391a4f6dd266c1ae78f077018ed2fd"} Jul 01 16:29:43.094593 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:43.094561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgx29" event={"ID":"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154","Type":"ContainerStarted","Data":"5706aa6f354a0cb7154b22986d890ba287d527e037bdfd45230d1d9e05c48d44"} Jul 01 16:29:44.021372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:44.021340 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm4ck" Jul 01 16:29:44.135147 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:44.135101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:44.195459 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:44.195425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:44.296848 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:44.296733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:44.351885 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:44.351848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:49.116819 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:49.116727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l64q8" event={"ID":"11537f17-066d-4033-ac9b-b702d77dcbe4","Type":"ContainerStarted","Data":"4a20eb00e0a357adf870218459d60dde59f06c56e44e5b863e8b23b6306132c8"} Jul 01 16:29:49.116819 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:49.116793 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:29:49.118275 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:49.118243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgx29" event={"ID":"6ea1111c-e0ea-45e1-a29b-aaccc6fbc154","Type":"ContainerStarted","Data":"be32c4c2d21e8fdac2aed39812ea9e9b7e00fed2fd6aa1c65fc6865e8627c3c0"} Jul 01 16:29:49.132122 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:49.132077 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l64q8" podStartSLOduration=65.359070814 podStartE2EDuration="1m11.132064653s" totalImagesPullingTime="5.772993839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:29:49.131862782 +0000 UTC m=+71.707555091" watchObservedRunningTime="2026-07-01 16:29:49.132064653 +0000 UTC m=+71.707756942" Jul 01 16:29:49.146573 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:49.146529 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tgx29" podStartSLOduration=65.384066075 podStartE2EDuration="1m11.146508121s" totalImagesPullingTime="5.762442046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:29:49.14555082 +0000 UTC m=+71.721243110" watchObservedRunningTime="2026-07-01 16:29:49.146508121 +0000 UTC m=+71.722200411" Jul 01 16:29:49.725142 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:49.725087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:29:49.725339 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:49.725243 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:29:49.725339 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:29:49.725308 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:30:21.725293483 +0000 UTC m=+104.300985751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:29:53.071740 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:53.071697 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:53.171714 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:53.171675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:29:54.531432 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:29:54.531402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:30:20.122404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:30:20.122372 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l64q8" Jul 01 16:30:21.749988 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:30:21.749948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:30:21.750569 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:30:21.750105 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:30:21.750569 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:30:21.750183 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:31:25.750163254 +0000 UTC m=+168.325855539 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:30:39.991908 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:30:39.991862 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:30:46.718556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:30:46.718516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:30:46.718963 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:30:46.718648 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 16:30:46.718963 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:30:46.718703 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs podName:79b89364-2abe-4125-be3a-1a96a0c1379c nodeName:}" failed. No retries permitted until 2026-07-01 16:32:48.71868935 +0000 UTC m=+251.294381631 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs") pod "network-metrics-daemon-g5vvh" (UID: "79b89364-2abe-4125-be3a-1a96a0c1379c") : secret "metrics-daemon-secret" not found Jul 01 16:31:20.853502 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:31:20.853436 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-757ql" podUID="1cf5670e-8038-4292-99c6-5a1e6f802583" Jul 01 16:31:20.877680 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:31:20.877641 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g5vvh" podUID="79b89364-2abe-4125-be3a-1a96a0c1379c" Jul 01 16:31:21.337652 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:21.337616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-757ql" Jul 01 16:31:25.783274 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:25.783211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:31:25.783710 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:31:25.783390 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:31:25.783710 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:31:25.783465 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls podName:1cf5670e-8038-4292-99c6-5a1e6f802583 nodeName:}" failed. No retries permitted until 2026-07-01 16:33:27.783450688 +0000 UTC m=+290.359142955 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls") pod "dns-default-757ql" (UID: "1cf5670e-8038-4292-99c6-5a1e6f802583") : secret "dns-default-metrics-tls" not found Jul 01 16:31:32.070308 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:32.070196 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" podUID="24621ea3-50ce-4c35-a4a4-87fe0b950a08" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jul 01 16:31:32.367243 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:32.367149 2562 generic.go:356] "Generic (PLEG): container finished" podID="24621ea3-50ce-4c35-a4a4-87fe0b950a08" containerID="799be49ef6744e6a7119395084eae72ba9a8f63d8b12a064dab92f3c6f0bd447" exitCode=1 Jul 01 16:31:32.367243 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:32.367229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" event={"ID":"24621ea3-50ce-4c35-a4a4-87fe0b950a08","Type":"ContainerDied","Data":"799be49ef6744e6a7119395084eae72ba9a8f63d8b12a064dab92f3c6f0bd447"} Jul 01 16:31:32.367583 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:32.367568 2562 scope.go:117] "RemoveContainer" containerID="799be49ef6744e6a7119395084eae72ba9a8f63d8b12a064dab92f3c6f0bd447" Jul 01 16:31:32.848521 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:32.848464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:31:33.372458 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:33.372418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" event={"ID":"24621ea3-50ce-4c35-a4a4-87fe0b950a08","Type":"ContainerStarted","Data":"01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594"} Jul 01 16:31:33.372910 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:33.372722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:31:33.373336 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:33.373324 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:31:49.839152 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:31:49.839106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:21.996434 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:21.996401 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f84f844d5-d96l8"] Jul 01 16:32:21.998016 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:21.997997 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-949b496c7-pc67d"] Jul 01 16:32:21.998132 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:21.998113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:21.999717 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:21.999694 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.003317 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003284 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 16:32:22.003494 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003458 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:32:22.003575 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003510 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 16:32:22.003633 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003600 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-th59d\"" Jul 01 16:32:22.003807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 16:32:22.003883 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003870 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:32:22.004016 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.003984 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:32:22.004087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.004014 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 16:32:22.004087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.004053 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jvvfl\"" Jul 01 16:32:22.004087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.004009 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 16:32:22.004087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.004076 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 16:32:22.012282 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.012257 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:32:22.016742 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.016688 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-949b496c7-pc67d"] Jul 01 16:32:22.019936 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.019909 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f84f844d5-d96l8"] Jul 01 16:32:22.072437 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-installation-pull-secrets\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072437 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-bound-sa-token\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlz7x\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-kube-api-access-xlz7x\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-stats-auth\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.072671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.072671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-default-certificate\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.072671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxz6\" (UniqueName: \"kubernetes.io/projected/1aaa5207-ca6c-4a4f-9132-af836d1da051-kube-api-access-hwxz6\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.072822 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-image-registry-private-configuration\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072822 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df00faf7-1ce5-45b6-926a-7f22babaf6ac-ca-trust-extracted\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072822 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.072822 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072822 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-certificates\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.072969 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.072817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-trusted-ca\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.090365 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.090328 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7d86v"] Jul 01 16:32:22.092045 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.092029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.094716 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.094692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 16:32:22.094716 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.094710 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 16:32:22.095185 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.095171 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x9mpr\"" Jul 01 16:32:22.095240 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.095177 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:32:22.095955 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.095926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 16:32:22.100436 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.100412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 16:32:22.103659 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.103617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7d86v"] Jul 01 16:32:22.174178 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-stats-auth\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.174178 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.174405 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-default-certificate\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.174405 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.174312 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:32:22.174405 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxz6\" (UniqueName: \"kubernetes.io/projected/1aaa5207-ca6c-4a4f-9132-af836d1da051-kube-api-access-hwxz6\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.174405 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-config\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.174405 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.174390 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:22.674368949 +0000 UTC m=+225.250061231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : secret "router-metrics-certs-default" not found Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-image-registry-private-configuration\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df00faf7-1ce5-45b6-926a-7f22babaf6ac-ca-trust-extracted\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5fc\" (UniqueName: \"kubernetes.io/projected/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-kube-api-access-mk5fc\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-trusted-ca\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-certificates\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-trusted-ca\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.174810 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:22.674792062 +0000 UTC m=+225.250484344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : configmap references non-existent config key: service-ca.crt Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-installation-pull-secrets\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df00faf7-1ce5-45b6-926a-7f22babaf6ac-ca-trust-extracted\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-bound-sa-token\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlz7x\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-kube-api-access-xlz7x\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.174925 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.174926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-serving-cert\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.175700 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.174947 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:32:22.175700 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.174962 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-949b496c7-pc67d: secret "image-registry-tls" not found Jul 01 16:32:22.175700 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.175016 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls podName:df00faf7-1ce5-45b6-926a-7f22babaf6ac nodeName:}" failed. No retries permitted until 2026-07-01 16:32:22.674999715 +0000 UTC m=+225.250692008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls") pod "image-registry-949b496c7-pc67d" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac") : secret "image-registry-tls" not found Jul 01 16:32:22.175700 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.175460 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-certificates\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.176073 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.175998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-trusted-ca\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.177286 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.177259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-stats-auth\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.177397 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.177313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-default-certificate\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.177607 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.177587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-image-registry-private-configuration\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.177728 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.177709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-installation-pull-secrets\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.182768 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.182745 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q"] Jul 01 16:32:22.185310 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.185289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.186056 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.186034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxz6\" (UniqueName: \"kubernetes.io/projected/1aaa5207-ca6c-4a4f-9132-af836d1da051-kube-api-access-hwxz6\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.187966 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.187942 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 16:32:22.188075 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.187971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-757wb\"" Jul 01 16:32:22.188075 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.187980 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 16:32:22.188256 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.188237 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:32:22.188396 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.188377 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 16:32:22.188761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.188739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-bound-sa-token\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.189733 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.189718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlz7x\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-kube-api-access-xlz7x\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.196706 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.196674 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q"] Jul 01 16:32:22.233982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.233948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:22.275862 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.275753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gzt5\" (UniqueName: \"kubernetes.io/projected/44eb7107-93a6-4610-b5ee-c8558778abdb-kube-api-access-5gzt5\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.275862 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.275843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44eb7107-93a6-4610-b5ee-c8558778abdb-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.276084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.275889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-serving-cert\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.276084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.275932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5fc\" (UniqueName: \"kubernetes.io/projected/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-kube-api-access-mk5fc\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.276084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.275950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-trusted-ca\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.276084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.275976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-config\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.276084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.276027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44eb7107-93a6-4610-b5ee-c8558778abdb-config\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.276982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.276952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-config\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.277321 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.277303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-trusted-ca\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.278559 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.278527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-serving-cert\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.283817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.283798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5fc\" (UniqueName: \"kubernetes.io/projected/51aa7164-1cb8-4687-94a2-5c1f6c9b73c0-kube-api-access-mk5fc\") pod \"console-operator-7fdbdf9c99-7d86v\" (UID: \"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.287530 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.287506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:22.377175 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.377136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44eb7107-93a6-4610-b5ee-c8558778abdb-config\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.377322 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.377185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gzt5\" (UniqueName: \"kubernetes.io/projected/44eb7107-93a6-4610-b5ee-c8558778abdb-kube-api-access-5gzt5\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.377322 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.377217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44eb7107-93a6-4610-b5ee-c8558778abdb-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.377785 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.377768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44eb7107-93a6-4610-b5ee-c8558778abdb-config\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.379623 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.379604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44eb7107-93a6-4610-b5ee-c8558778abdb-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.384883 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.384856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gzt5\" (UniqueName: \"kubernetes.io/projected/44eb7107-93a6-4610-b5ee-c8558778abdb-kube-api-access-5gzt5\") pod \"service-ca-operator-5d7b7dc95c-6fk5q\" (UID: \"44eb7107-93a6-4610-b5ee-c8558778abdb\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.401851 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.401822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:22.504798 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.504764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" Jul 01 16:32:22.532090 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.532065 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-7d86v"] Jul 01 16:32:22.534735 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:22.534703 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51aa7164_1cb8_4687_94a2_5c1f6c9b73c0.slice/crio-428e47669734e511afbcb065049e7ed27c79fbe3122796667fcb3d67b29008c9 WatchSource:0}: Error finding container 428e47669734e511afbcb065049e7ed27c79fbe3122796667fcb3d67b29008c9: Status 404 returned error can't find the container with id 428e47669734e511afbcb065049e7ed27c79fbe3122796667fcb3d67b29008c9 Jul 01 16:32:22.635786 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.635754 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q"] Jul 01 16:32:22.638275 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:22.638253 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44eb7107_93a6_4610_b5ee_c8558778abdb.slice/crio-266a8fff8dcbdc836fee9242b62a5809036d0d41490a44a36f6db9e2204fd73c WatchSource:0}: Error finding container 266a8fff8dcbdc836fee9242b62a5809036d0d41490a44a36f6db9e2204fd73c: Status 404 returned error can't find the container with id 266a8fff8dcbdc836fee9242b62a5809036d0d41490a44a36f6db9e2204fd73c Jul 01 16:32:22.680341 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.680304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:22.680341 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.680355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.680599 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:22.680432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:22.680599 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.680471 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:32:22.680599 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.680518 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-949b496c7-pc67d: secret "image-registry-tls" not found Jul 01 16:32:22.680599 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.680564 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:32:22.680599 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.680590 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls podName:df00faf7-1ce5-45b6-926a-7f22babaf6ac nodeName:}" failed. No retries permitted until 2026-07-01 16:32:23.680574283 +0000 UTC m=+226.256266551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls") pod "image-registry-949b496c7-pc67d" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac") : secret "image-registry-tls" not found Jul 01 16:32:22.680796 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.680608 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:23.680596465 +0000 UTC m=+226.256288745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : secret "router-metrics-certs-default" not found Jul 01 16:32:22.680796 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:22.680621 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:23.680615954 +0000 UTC m=+226.256308221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : configmap references non-existent config key: service-ca.crt Jul 01 16:32:23.514152 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:23.514111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" event={"ID":"44eb7107-93a6-4610-b5ee-c8558778abdb","Type":"ContainerStarted","Data":"266a8fff8dcbdc836fee9242b62a5809036d0d41490a44a36f6db9e2204fd73c"} Jul 01 16:32:23.515624 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:23.515587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" event={"ID":"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0","Type":"ContainerStarted","Data":"428e47669734e511afbcb065049e7ed27c79fbe3122796667fcb3d67b29008c9"} Jul 01 16:32:23.688789 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:23.688752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:23.688789 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:23.688801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:23.688987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:23.688877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:23.688987 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:23.688916 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:32:23.688987 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:23.688937 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-949b496c7-pc67d: secret "image-registry-tls" not found Jul 01 16:32:23.688987 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:23.688972 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:32:23.689102 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:23.688993 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls podName:df00faf7-1ce5-45b6-926a-7f22babaf6ac nodeName:}" failed. No retries permitted until 2026-07-01 16:32:25.688979413 +0000 UTC m=+228.264671681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls") pod "image-registry-949b496c7-pc67d" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac") : secret "image-registry-tls" not found Jul 01 16:32:23.689102 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:23.689014 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:25.689001554 +0000 UTC m=+228.264693851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : secret "router-metrics-certs-default" not found Jul 01 16:32:23.689102 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:23.689027 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:25.689021519 +0000 UTC m=+228.264713787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : configmap references non-existent config key: service-ca.crt Jul 01 16:32:24.381871 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:24.381827 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:24.428139 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:24.428101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:25.524637 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.524550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" event={"ID":"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0","Type":"ContainerStarted","Data":"affdd8ba59b43af4c4f4f78defbea718f4c033cf74370ce0397b4d2a83df6981"} Jul 01 16:32:25.525089 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.524765 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:25.526045 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.526010 2562 patch_prober.go:28] interesting pod/console-operator-7fdbdf9c99-7d86v container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jul 01 16:32:25.526193 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.526061 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" podUID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused" Jul 01 16:32:25.543277 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.543219 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" podStartSLOduration=0.872889927 podStartE2EDuration="3.543203058s" totalImagesPullingTime="2.670313131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:32:25.54134316 +0000 UTC m=+228.117035449" watchObservedRunningTime="2026-07-01 16:32:25.543203058 +0000 UTC m=+228.118895351" Jul 01 16:32:25.708471 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.708422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:25.708668 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.708499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:25.708668 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:25.708534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:25.708668 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:25.708629 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:29.708606995 +0000 UTC m=+232.284299280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : configmap references non-existent config key: service-ca.crt Jul 01 16:32:25.708668 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:25.708661 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:32:25.708880 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:25.708719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:29.708701998 +0000 UTC m=+232.284394317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : secret "router-metrics-certs-default" not found Jul 01 16:32:25.708880 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:25.708660 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:32:25.708880 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:25.708745 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-949b496c7-pc67d: secret "image-registry-tls" not found Jul 01 16:32:25.708880 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:25.708773 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls podName:df00faf7-1ce5-45b6-926a-7f22babaf6ac nodeName:}" failed. No retries permitted until 2026-07-01 16:32:29.708762754 +0000 UTC m=+232.284455022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls") pod "image-registry-949b496c7-pc67d" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac") : secret "image-registry-tls" not found Jul 01 16:32:26.528634 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.528592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" event={"ID":"44eb7107-93a6-4610-b5ee-c8558778abdb","Type":"ContainerStarted","Data":"a5361e2478801bb39fd2198dc81c203f0e229a1ee580ed5f35e246fa222b2ab1"} Jul 01 16:32:26.530019 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.530001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/0.log" Jul 01 16:32:26.530081 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.530038 2562 generic.go:356] "Generic (PLEG): container finished" podID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" containerID="affdd8ba59b43af4c4f4f78defbea718f4c033cf74370ce0397b4d2a83df6981" exitCode=255 Jul 01 16:32:26.530116 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.530079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" event={"ID":"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0","Type":"ContainerDied","Data":"affdd8ba59b43af4c4f4f78defbea718f4c033cf74370ce0397b4d2a83df6981"} Jul 01 16:32:26.530348 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.530335 2562 scope.go:117] "RemoveContainer" containerID="affdd8ba59b43af4c4f4f78defbea718f4c033cf74370ce0397b4d2a83df6981" Jul 01 16:32:26.543651 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.543608 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" podStartSLOduration=1.387537687 podStartE2EDuration="4.543591202s" totalImagesPullingTime="3.156053515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:32:26.543153697 +0000 UTC m=+229.118845987" watchObservedRunningTime="2026-07-01 16:32:26.543591202 +0000 UTC m=+229.119283493" Jul 01 16:32:26.577264 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.577231 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:26.626829 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.626783 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:26.755989 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.755946 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k5mzn"] Jul 01 16:32:26.757955 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.757936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:26.760667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.760644 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:32:26.760667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.760648 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:32:26.760883 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.760736 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:32:26.760942 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.760889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zs8wh\"" Jul 01 16:32:26.761137 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.761121 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:32:26.772358 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.772332 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k5mzn"] Jul 01 16:32:26.790757 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.790656 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:26.869344 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.869308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:26.918066 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.918027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:26.918066 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.918067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca677b7e-ba0f-4446-a123-d0bf18b83970-data-volume\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:26.918324 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.918094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56krh\" (UniqueName: \"kubernetes.io/projected/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-api-access-56krh\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:26.918324 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.918125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca677b7e-ba0f-4446-a123-d0bf18b83970-crio-socket\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:26.918324 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.918191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:26.924913 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:26.924881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:27.018845 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.018800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.019022 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.018923 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:32:27.019022 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.018928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.019022 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.018999 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:27.518982638 +0000 UTC m=+230.094674941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : configmap "kube-rbac-proxy" not found Jul 01 16:32:27.019022 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.019006 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:32:27.019154 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.019048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca677b7e-ba0f-4446-a123-d0bf18b83970-data-volume\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.019154 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.019060 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:27.519049024 +0000 UTC m=+230.094741292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : secret "insights-runtime-extractor-tls" not found Jul 01 16:32:27.019154 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.019099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56krh\" (UniqueName: \"kubernetes.io/projected/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-api-access-56krh\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.019154 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.019128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca677b7e-ba0f-4446-a123-d0bf18b83970-crio-socket\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.019276 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.019199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca677b7e-ba0f-4446-a123-d0bf18b83970-crio-socket\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.019324 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.019308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca677b7e-ba0f-4446-a123-d0bf18b83970-data-volume\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.025273 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.025193 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:27.027848 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.027826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56krh\" (UniqueName: \"kubernetes.io/projected/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-api-access-56krh\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.522901 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.522844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.522901 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.522918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:27.523160 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.523023 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:32:27.523160 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.523033 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:32:27.523160 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.523095 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:28.523079217 +0000 UTC m=+231.098771490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : secret "insights-runtime-extractor-tls" not found Jul 01 16:32:27.523160 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.523113 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:28.523105849 +0000 UTC m=+231.098798117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : configmap "kube-rbac-proxy" not found Jul 01 16:32:27.534743 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.534718 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:32:27.535140 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.535122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/0.log" Jul 01 16:32:27.535195 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.535163 2562 generic.go:356] "Generic (PLEG): container finished" podID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" containerID="9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e" exitCode=255 Jul 01 16:32:27.535268 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.535249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" event={"ID":"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0","Type":"ContainerDied","Data":"9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e"} Jul 01 16:32:27.535354 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.535340 2562 scope.go:117] "RemoveContainer" containerID="affdd8ba59b43af4c4f4f78defbea718f4c033cf74370ce0397b4d2a83df6981" Jul 01 16:32:27.535595 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.535569 2562 scope.go:117] "RemoveContainer" containerID="9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e" Jul 01 16:32:27.535795 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:27.535768 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7d86v_openshift-console-operator(51aa7164-1cb8-4687-94a2-5c1f6c9b73c0)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" podUID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" Jul 01 16:32:27.932861 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:27.932774 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:28.521459 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:28.521431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8k45g_4809f2d1-90dc-4499-9559-d31551ade25c/dns-node-resolver/0.log" Jul 01 16:32:28.531809 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:28.531778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:28.531902 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:28.531836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:28.531989 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:28.531970 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:32:28.532029 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:28.532000 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:32:28.532059 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:28.532045 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:30.532026195 +0000 UTC m=+233.107718481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : configmap "kube-rbac-proxy" not found Jul 01 16:32:28.532099 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:28.532061 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:30.532054896 +0000 UTC m=+233.107747164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : secret "insights-runtime-extractor-tls" not found Jul 01 16:32:28.540633 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:28.540605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:32:28.541044 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:28.541021 2562 scope.go:117] "RemoveContainer" containerID="9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e" Jul 01 16:32:28.541205 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:28.541187 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7d86v_openshift-console-operator(51aa7164-1cb8-4687-94a2-5c1f6c9b73c0)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" podUID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" Jul 01 16:32:28.959359 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:28.959320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:29.008797 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.008766 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:29.428627 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.428535 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:29.481912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.481874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:29.521215 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.521192 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d42pq_c54ccd70-1122-45ee-bd23-12c3535cfe86/node-ca/0.log" Jul 01 16:32:29.742141 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.742094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:29.742141 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.742150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:29.742177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:29.742275 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:37.742257391 +0000 UTC m=+240.317949672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : configmap references non-existent config key: service-ca.crt Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:29.742316 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:29.742322 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:29.742341 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-949b496c7-pc67d: secret "image-registry-tls" not found Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:29.742369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:37.742350273 +0000 UTC m=+240.318042544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : secret "router-metrics-certs-default" not found Jul 01 16:32:29.742598 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:29.742383 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls podName:df00faf7-1ce5-45b6-926a-7f22babaf6ac nodeName:}" failed. No retries permitted until 2026-07-01 16:32:37.74237579 +0000 UTC m=+240.318068058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls") pod "image-registry-949b496c7-pc67d" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac") : secret "image-registry-tls" not found Jul 01 16:32:30.057932 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:30.057846 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:30.548671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:30.548641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:30.548866 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:30.548692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:30.548866 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:30.548795 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:32:30.548866 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:30.548821 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:32:30.548866 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:30.548850 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:34.548835795 +0000 UTC m=+237.124528081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : secret "insights-runtime-extractor-tls" not found Jul 01 16:32:30.549066 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:30.548906 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:34.548895706 +0000 UTC m=+237.124587975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : configmap "kube-rbac-proxy" not found Jul 01 16:32:30.721307 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:30.721270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqxxd_e96aa6e7-359b-4778-bbb5-a255b3418abe/serve-healthcheck-canary/0.log" Jul 01 16:32:32.402724 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:32.402619 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:32.403089 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:32.403015 2562 scope.go:117] "RemoveContainer" containerID="9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e" Jul 01 16:32:32.403178 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:32.403157 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7d86v_openshift-console-operator(51aa7164-1cb8-4687-94a2-5c1f6c9b73c0)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" podUID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" Jul 01 16:32:32.656314 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:32.656222 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:32.861583 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:32.861547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:32.916890 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:32.916791 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:33.045390 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:33.045357 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:33.205051 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:33.205014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:33.303514 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:33.303464 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:33.483101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:33.483016 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:33.950695 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:33.950656 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:34.550678 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:34.550638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:34.583579 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:34.583541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:34.583759 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:34.583600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:34.583759 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:34.583688 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:32:34.583759 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:34.583689 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:32:34.583759 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:34.583756 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:42.583741328 +0000 UTC m=+245.159433599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : configmap "kube-rbac-proxy" not found Jul 01 16:32:34.583896 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:34.583769 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:42.583763637 +0000 UTC m=+245.159455905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : secret "insights-runtime-extractor-tls" not found Jul 01 16:32:34.946637 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:34.946598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:35.356267 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:35.356159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:35.525809 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:35.525772 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:35.526191 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:35.526178 2562 scope.go:117] "RemoveContainer" containerID="9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e" Jul 01 16:32:35.526361 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:35.526342 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-7d86v_openshift-console-operator(51aa7164-1cb8-4687-94a2-5c1f6c9b73c0)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" podUID="51aa7164-1cb8-4687-94a2-5c1f6c9b73c0" Jul 01 16:32:35.618543 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:35.618442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:35.947539 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:35.947510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:36.356674 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:36.356580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:36.477738 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:36.477701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:36.578160 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:36.578129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:36.626593 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:36.626472 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:36.948272 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:36.948239 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:37.153374 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.153343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:37.747559 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.747525 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:37.810038 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.810002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:37.810215 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.810105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:37.810215 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.810124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:37.810323 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:37.810295 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle podName:1aaa5207-ca6c-4a4f-9132-af836d1da051 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:53.810272225 +0000 UTC m=+256.385964507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle") pod "router-default-f84f844d5-d96l8" (UID: "1aaa5207-ca6c-4a4f-9132-af836d1da051") : configmap references non-existent config key: service-ca.crt Jul 01 16:32:37.812669 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.812647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aaa5207-ca6c-4a4f-9132-af836d1da051-metrics-certs\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:37.812795 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.812647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"image-registry-949b496c7-pc67d\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:37.916836 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.916804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jvvfl\"" Jul 01 16:32:37.924834 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:37.924812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:38.055345 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.055315 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-949b496c7-pc67d"] Jul 01 16:32:38.058707 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:38.058677 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf00faf7_1ce5_45b6_926a_7f22babaf6ac.slice/crio-fb5fc3d9c712036e5b936071895038099c5fe2463147b488a892b5c0647fab05 WatchSource:0}: Error finding container fb5fc3d9c712036e5b936071895038099c5fe2463147b488a892b5c0647fab05: Status 404 returned error can't find the container with id fb5fc3d9c712036e5b936071895038099c5fe2463147b488a892b5c0647fab05 Jul 01 16:32:38.350046 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.349945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:38.551805 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.551770 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:38.571928 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.571884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-949b496c7-pc67d" event={"ID":"df00faf7-1ce5-45b6-926a-7f22babaf6ac","Type":"ContainerStarted","Data":"0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527"} Jul 01 16:32:38.572121 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.571976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-949b496c7-pc67d" event={"ID":"df00faf7-1ce5-45b6-926a-7f22babaf6ac","Type":"ContainerStarted","Data":"fb5fc3d9c712036e5b936071895038099c5fe2463147b488a892b5c0647fab05"} Jul 01 16:32:38.572121 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.572002 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:32:38.623160 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.623057 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-949b496c7-pc67d" podStartSLOduration=17.623043096 podStartE2EDuration="17.623043096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:32:38.622769631 +0000 UTC m=+241.198461983" watchObservedRunningTime="2026-07-01 16:32:38.623043096 +0000 UTC m=+241.198735385" Jul 01 16:32:38.746449 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:38.746412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:39.149490 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:39.149448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:39.207022 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:39.206988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:39.558120 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:39.558087 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:39.863106 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:39.863021 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:40.352591 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:40.352557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:41.390888 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:41.390847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:41.442712 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:41.442677 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:41.553921 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:41.553890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:42.014248 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.014216 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:42.065049 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.065013 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:42.499911 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.499875 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:42.600999 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.600960 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:42.647226 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.647188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:42.647319 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.647247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:42.647360 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:42.647350 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:32:42.647431 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:32:42.647420 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls podName:ca677b7e-ba0f-4446-a123-d0bf18b83970 nodeName:}" failed. No retries permitted until 2026-07-01 16:32:58.647401994 +0000 UTC m=+261.223094276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5mzn" (UID: "ca677b7e-ba0f-4446-a123-d0bf18b83970") : secret "insights-runtime-extractor-tls" not found Jul 01 16:32:42.647891 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.647872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca677b7e-ba0f-4446-a123-d0bf18b83970-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:42.947297 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:42.947266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:43.144748 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:43.144703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:43.366814 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:43.366720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:48.799443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:48.799402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:32:48.801860 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:48.801837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79b89364-2abe-4125-be3a-1a96a0c1379c-metrics-certs\") pod \"network-metrics-daemon-g5vvh\" (UID: \"79b89364-2abe-4125-be3a-1a96a0c1379c\") " pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:32:48.824441 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:48.824408 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-949b496c7-pc67d"] Jul 01 16:32:48.945649 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:48.945617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:49.046304 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:49.046261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:49.051491 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:49.051422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jf2dq\"" Jul 01 16:32:49.059517 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:49.059496 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5vvh" Jul 01 16:32:49.184674 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:49.184642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5vvh"] Jul 01 16:32:49.187716 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:49.187684 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b89364_2abe_4125_be3a_1a96a0c1379c.slice/crio-9e918cb0ef1b005a6638788938f211fd5b51116346873d97cdc3d1e96eec5cbd WatchSource:0}: Error finding container 9e918cb0ef1b005a6638788938f211fd5b51116346873d97cdc3d1e96eec5cbd: Status 404 returned error can't find the container with id 9e918cb0ef1b005a6638788938f211fd5b51116346873d97cdc3d1e96eec5cbd Jul 01 16:32:49.604423 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:49.604382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5vvh" event={"ID":"79b89364-2abe-4125-be3a-1a96a0c1379c","Type":"ContainerStarted","Data":"9e918cb0ef1b005a6638788938f211fd5b51116346873d97cdc3d1e96eec5cbd"} Jul 01 16:32:50.608613 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.608574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5vvh" event={"ID":"79b89364-2abe-4125-be3a-1a96a0c1379c","Type":"ContainerStarted","Data":"c4b5af3aee92201bb3b45dbff87f2b8b9edc82d8ca3646899f479d711e583d5c"} Jul 01 16:32:50.609081 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.608635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5vvh" event={"ID":"79b89364-2abe-4125-be3a-1a96a0c1379c","Type":"ContainerStarted","Data":"1a2a6aa041db138489b4dba66de1e946fcf9b225d03e442967f4f7cee17f6981"} Jul 01 16:32:50.630259 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.630211 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g5vvh" podStartSLOduration=251.82477291 podStartE2EDuration="4m12.630196505s" totalImagesPullingTime="805.423595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:32:50.629358666 +0000 UTC m=+253.205050966" watchObservedRunningTime="2026-07-01 16:32:50.630196505 +0000 UTC m=+253.205888801" Jul 01 16:32:50.703606 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.703568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:50.805782 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.805749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:50.849015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.848978 2562 scope.go:117] "RemoveContainer" containerID="9d72962945b04a673a552951d6bf13af4ce84490344d81d270599432d4201e3e" Jul 01 16:32:50.904546 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:50.904516 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:51.552884 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.552848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:51.614104 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.614076 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:32:51.614533 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.614152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" event={"ID":"51aa7164-1cb8-4687-94a2-5c1f6c9b73c0","Type":"ContainerStarted","Data":"a0cafc7846e8cfb03c8133c433ffcb8d51f98eb927a30fde54bcbd0f0ae16f05"} Jul 01 16:32:51.614614 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.614529 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:51.619246 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.619224 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-7d86v" Jul 01 16:32:51.651675 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.651639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:51.838008 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:51.837922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:52.241393 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:52.241357 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:52.527688 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:52.527604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:52.960072 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:52.960039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:53.060705 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.060673 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:53.161136 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.161101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:53.261242 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.261145 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:53.433362 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.433323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:53.535549 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.535444 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:53.836248 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.836156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:53.836748 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:53.836730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1aaa5207-ca6c-4a4f-9132-af836d1da051-service-ca-bundle\") pod \"router-default-f84f844d5-d96l8\" (UID: \"1aaa5207-ca6c-4a4f-9132-af836d1da051\") " pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:54.111892 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.111805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-th59d\"" Jul 01 16:32:54.120055 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.120028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:54.252358 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.252327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f84f844d5-d96l8"] Jul 01 16:32:54.255336 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:54.255306 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aaa5207_ca6c_4a4f_9132_af836d1da051.slice/crio-bf54423e24ce874835d7054d101d01cd20d4b9e0310a5a2310ba45f40cc9e519 WatchSource:0}: Error finding container bf54423e24ce874835d7054d101d01cd20d4b9e0310a5a2310ba45f40cc9e519: Status 404 returned error can't find the container with id bf54423e24ce874835d7054d101d01cd20d4b9e0310a5a2310ba45f40cc9e519 Jul 01 16:32:54.625064 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.625031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f84f844d5-d96l8" event={"ID":"1aaa5207-ca6c-4a4f-9132-af836d1da051","Type":"ContainerStarted","Data":"c53ccec46fe41be2a54fee24d0238e3a9354eb00c2df3ec9245c8415d28622a1"} Jul 01 16:32:54.625231 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.625077 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f84f844d5-d96l8" event={"ID":"1aaa5207-ca6c-4a4f-9132-af836d1da051","Type":"ContainerStarted","Data":"bf54423e24ce874835d7054d101d01cd20d4b9e0310a5a2310ba45f40cc9e519"} Jul 01 16:32:54.643733 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.643676 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f84f844d5-d96l8" podStartSLOduration=33.643656323 podStartE2EDuration="33.643656323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:32:54.642164074 +0000 UTC m=+257.217856399" watchObservedRunningTime="2026-07-01 16:32:54.643656323 +0000 UTC m=+257.219348614" Jul 01 16:32:54.852588 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.852547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:54.903408 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:54.903309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:55.121111 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:55.121070 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:55.123758 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:55.123731 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:55.628543 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:55.628507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:55.629835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:55.629813 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f84f844d5-d96l8" Jul 01 16:32:56.823843 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:56.823805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:56.924490 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:56.924454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:57.028572 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.028533 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:57.089318 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.089227 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh"] Jul 01 16:32:57.092215 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.092191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:32:57.094730 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.094709 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 16:32:57.094834 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.094815 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5hm74\"" Jul 01 16:32:57.098955 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.098936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh"] Jul 01 16:32:57.103677 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.103647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:57.162074 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.162017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1bffdbec-f12c-4209-9048-3743ec31b1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tn7zh\" (UID: \"1bffdbec-f12c-4209-9048-3743ec31b1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:32:57.227085 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.227051 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:57.263081 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.263034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1bffdbec-f12c-4209-9048-3743ec31b1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tn7zh\" (UID: \"1bffdbec-f12c-4209-9048-3743ec31b1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:32:57.265627 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.265606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1bffdbec-f12c-4209-9048-3743ec31b1e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tn7zh\" (UID: \"1bffdbec-f12c-4209-9048-3743ec31b1e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:32:57.401992 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.401904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:32:57.548975 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.548948 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh"] Jul 01 16:32:57.551341 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:57.551309 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bffdbec_f12c_4209_9048_3743ec31b1e3.slice/crio-408464c4f6ae2fcad6c0b3d74917985bb896be55a3f6d77901c123a03c701536 WatchSource:0}: Error finding container 408464c4f6ae2fcad6c0b3d74917985bb896be55a3f6d77901c123a03c701536: Status 404 returned error can't find the container with id 408464c4f6ae2fcad6c0b3d74917985bb896be55a3f6d77901c123a03c701536 Jul 01 16:32:57.575586 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.575557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:57.635780 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.635735 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:32:57.635979 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:57.635952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" event={"ID":"1bffdbec-f12c-4209-9048-3743ec31b1e3","Type":"ContainerStarted","Data":"408464c4f6ae2fcad6c0b3d74917985bb896be55a3f6d77901c123a03c701536"} Jul 01 16:32:58.673410 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:58.673364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:58.675872 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:58.675848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca677b7e-ba0f-4446-a123-d0bf18b83970-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5mzn\" (UID: \"ca677b7e-ba0f-4446-a123-d0bf18b83970\") " pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:58.830234 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:58.830157 2562 patch_prober.go:28] interesting pod/image-registry-949b496c7-pc67d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 16:32:58.830234 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:58.830211 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-949b496c7-pc67d" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:32:58.869595 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:58.869571 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zs8wh\"" Jul 01 16:32:58.877774 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:58.877752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k5mzn" Jul 01 16:32:59.045924 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:59.045893 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k5mzn"] Jul 01 16:32:59.048675 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:32:59.048639 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca677b7e_ba0f_4446_a123_d0bf18b83970.slice/crio-16c1f494fe7ea3788462c1e1ffeb3cc170ebdc837782efe8f0f1a4987eef63a8 WatchSource:0}: Error finding container 16c1f494fe7ea3788462c1e1ffeb3cc170ebdc837782efe8f0f1a4987eef63a8: Status 404 returned error can't find the container with id 16c1f494fe7ea3788462c1e1ffeb3cc170ebdc837782efe8f0f1a4987eef63a8 Jul 01 16:32:59.642979 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:32:59.642948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5mzn" event={"ID":"ca677b7e-ba0f-4446-a123-d0bf18b83970","Type":"ContainerStarted","Data":"16c1f494fe7ea3788462c1e1ffeb3cc170ebdc837782efe8f0f1a4987eef63a8"} Jul 01 16:33:00.648293 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:00.648255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" event={"ID":"1bffdbec-f12c-4209-9048-3743ec31b1e3","Type":"ContainerStarted","Data":"7ee70c3d8406ae09c4de0283019207605ce0d344f7c1ce8fa30b87784f6077a4"} Jul 01 16:33:00.648741 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:00.648500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:33:00.653902 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:00.653881 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" Jul 01 16:33:00.663495 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:00.663413 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tn7zh" podStartSLOduration=1.554491186 podStartE2EDuration="3.663392856s" totalImagesPullingTime="2.10890167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:00.661767718 +0000 UTC m=+263.237460003" watchObservedRunningTime="2026-07-01 16:33:00.663392856 +0000 UTC m=+263.239085128" Jul 01 16:33:01.125443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.125402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:01.170687 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.170656 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-4hwnd"] Jul 01 16:33:01.181166 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.181131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.181981 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.181947 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-4hwnd"] Jul 01 16:33:01.183943 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.183793 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 16:33:01.183943 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.183804 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:33:01.185304 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.185280 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:33:01.185304 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.185296 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:33:01.185988 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.185598 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5z5xc\"" Jul 01 16:33:01.185988 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.185810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 16:33:01.186984 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.186956 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:01.296530 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.296496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08d11454-820d-41cb-a354-e3459f09826a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.296722 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.296552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.296722 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.296674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.296843 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.296725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99plq\" (UniqueName: \"kubernetes.io/projected/08d11454-820d-41cb-a354-e3459f09826a-kube-api-access-99plq\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.397891 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.397778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.397891 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.397879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.398117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.397923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99plq\" (UniqueName: \"kubernetes.io/projected/08d11454-820d-41cb-a354-e3459f09826a-kube-api-access-99plq\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.398117 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.397963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08d11454-820d-41cb-a354-e3459f09826a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.398117 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:01.398001 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 16:33:01.398117 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:01.398087 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls podName:08d11454-820d-41cb-a354-e3459f09826a nodeName:}" failed. No retries permitted until 2026-07-01 16:33:01.898068883 +0000 UTC m=+264.473761171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-4hwnd" (UID: "08d11454-820d-41cb-a354-e3459f09826a") : secret "prometheus-operator-tls" not found Jul 01 16:33:01.398823 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.398801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08d11454-820d-41cb-a354-e3459f09826a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.401179 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.401153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.406875 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.406851 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99plq\" (UniqueName: \"kubernetes.io/projected/08d11454-820d-41cb-a354-e3459f09826a-kube-api-access-99plq\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.664749 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.664676 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c85f6fbbc-d5xn8"] Jul 01 16:33:01.678301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.678257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.681088 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.681057 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c85f6fbbc-d5xn8"] Jul 01 16:33:01.681826 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.681802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 16:33:01.681950 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.681803 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 16:33:01.682972 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.682880 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-64wzh\"" Jul 01 16:33:01.683400 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.683151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 16:33:01.683400 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.683153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 16:33:01.683400 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.683267 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 16:33:01.683400 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.683306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 16:33:01.683400 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.683392 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 16:33:01.699695 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.699663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-service-ca\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.699863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.699818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-oauth-config\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.699863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.699856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-console-config\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.699962 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.699892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br79p\" (UniqueName: \"kubernetes.io/projected/9ab45318-673d-4fa6-8898-2db456a1d11f-kube-api-access-br79p\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.700008 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.699958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-serving-cert\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.700070 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.700046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-oauth-serving-cert\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.800463 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.800426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-oauth-config\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.800463 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.800464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-console-config\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.800728 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.800511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br79p\" (UniqueName: \"kubernetes.io/projected/9ab45318-673d-4fa6-8898-2db456a1d11f-kube-api-access-br79p\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.800728 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.800551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-serving-cert\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.800728 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.800608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-oauth-serving-cert\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.800728 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.800635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-service-ca\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.801238 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.801210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-console-config\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.801379 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.801319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-service-ca\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.801732 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.801708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-oauth-serving-cert\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.808032 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.803696 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-oauth-config\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.808032 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.803768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-serving-cert\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.811737 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.811704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br79p\" (UniqueName: \"kubernetes.io/projected/9ab45318-673d-4fa6-8898-2db456a1d11f-kube-api-access-br79p\") pod \"console-6c85f6fbbc-d5xn8\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:01.901424 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.901381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:01.901612 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:01.901535 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 16:33:01.901612 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:01.901600 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls podName:08d11454-820d-41cb-a354-e3459f09826a nodeName:}" failed. No retries permitted until 2026-07-01 16:33:02.901582234 +0000 UTC m=+265.477274521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-4hwnd" (UID: "08d11454-820d-41cb-a354-e3459f09826a") : secret "prometheus-operator-tls" not found Jul 01 16:33:01.992966 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:01.992925 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:02.461183 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:02.461125 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:02.910800 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:02.910701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:02.913938 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:02.913903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08d11454-820d-41cb-a354-e3459f09826a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-4hwnd\" (UID: \"08d11454-820d-41cb-a354-e3459f09826a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:02.993639 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:02.993607 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" Jul 01 16:33:03.078853 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:03.078828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c85f6fbbc-d5xn8"] Jul 01 16:33:03.081052 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:03.081023 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab45318_673d_4fa6_8898_2db456a1d11f.slice/crio-5f8e246855273f5cc83f1c5adc8a8b0f83573d4773d39e05f9d9a9401152828e WatchSource:0}: Error finding container 5f8e246855273f5cc83f1c5adc8a8b0f83573d4773d39e05f9d9a9401152828e: Status 404 returned error can't find the container with id 5f8e246855273f5cc83f1c5adc8a8b0f83573d4773d39e05f9d9a9401152828e Jul 01 16:33:03.140037 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:03.140005 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-4hwnd"] Jul 01 16:33:03.142790 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:03.142760 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d11454_820d_41cb_a354_e3459f09826a.slice/crio-1bf20f05735fe2e80bba6e0022f5c840214250f1a9c6d4d9dad2936de12657c1 WatchSource:0}: Error finding container 1bf20f05735fe2e80bba6e0022f5c840214250f1a9c6d4d9dad2936de12657c1: Status 404 returned error can't find the container with id 1bf20f05735fe2e80bba6e0022f5c840214250f1a9c6d4d9dad2936de12657c1 Jul 01 16:33:03.660857 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:03.660820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5mzn" event={"ID":"ca677b7e-ba0f-4446-a123-d0bf18b83970","Type":"ContainerStarted","Data":"816295efb47d2cec2dd2ab378f9239c9509758106591f3c76ca0cd287e62f46f"} Jul 01 16:33:03.662062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:03.662029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" event={"ID":"08d11454-820d-41cb-a354-e3459f09826a","Type":"ContainerStarted","Data":"1bf20f05735fe2e80bba6e0022f5c840214250f1a9c6d4d9dad2936de12657c1"} Jul 01 16:33:03.663364 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:03.663330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85f6fbbc-d5xn8" event={"ID":"9ab45318-673d-4fa6-8898-2db456a1d11f","Type":"ContainerStarted","Data":"5f8e246855273f5cc83f1c5adc8a8b0f83573d4773d39e05f9d9a9401152828e"} Jul 01 16:33:04.669194 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:04.669113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5mzn" event={"ID":"ca677b7e-ba0f-4446-a123-d0bf18b83970","Type":"ContainerStarted","Data":"322550eacb3c786af0f5d68610852aad0760fd01efd966f7215657913d52978f"} Jul 01 16:33:06.443342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.443302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:06.678524 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.678430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85f6fbbc-d5xn8" event={"ID":"9ab45318-673d-4fa6-8898-2db456a1d11f","Type":"ContainerStarted","Data":"f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4"} Jul 01 16:33:06.680423 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.680392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" event={"ID":"08d11454-820d-41cb-a354-e3459f09826a","Type":"ContainerStarted","Data":"9794cebdc8e8fef1228380a69bf91c266993f7e9b7b5028fbc81ad7d524c93a5"} Jul 01 16:33:06.680603 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.680448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" event={"ID":"08d11454-820d-41cb-a354-e3459f09826a","Type":"ContainerStarted","Data":"f5148124dd1b4af4352fbdbfdc96be049d912c435ce7480300041ca23322d853"} Jul 01 16:33:06.697750 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.697647 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c85f6fbbc-d5xn8" podStartSLOduration=2.673934162 podStartE2EDuration="5.697626903s" totalImagesPullingTime="3.023692741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:06.697056204 +0000 UTC m=+269.272748494" watchObservedRunningTime="2026-07-01 16:33:06.697626903 +0000 UTC m=+269.273319171" Jul 01 16:33:06.714681 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.714627 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-4hwnd" podStartSLOduration=2.75588347 podStartE2EDuration="5.71461015s" totalImagesPullingTime="2.95872668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:06.713604794 +0000 UTC m=+269.289297083" watchObservedRunningTime="2026-07-01 16:33:06.71461015 +0000 UTC m=+269.290302439" Jul 01 16:33:06.958613 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:06.958471 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:07.163539 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:07.163496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:07.852929 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:07.852877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:07.953349 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:07.953314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.253604 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.253569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.472260 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.472227 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.488101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.488070 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht"] Jul 01 16:33:08.491646 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.491622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.494248 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.494215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 16:33:08.494374 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.494226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-95xd6\"" Jul 01 16:33:08.494434 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.494399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 16:33:08.502518 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.502493 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht"] Jul 01 16:33:08.527027 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.526940 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wbswv"] Jul 01 16:33:08.530131 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.530109 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.532699 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.532676 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:33:08.532812 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.532786 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fx4fv\"" Jul 01 16:33:08.532932 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.532911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:33:08.533238 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.533222 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:33:08.562337 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-sys\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562337 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66158722-15b9-4014-93ac-aa874e0540b8-metrics-client-ca\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.562621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-textfile\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-wtmp\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.562621 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-tls\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpnn7\" (UniqueName: \"kubernetes.io/projected/66158722-15b9-4014-93ac-aa874e0540b8-kube-api-access-cpnn7\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.562863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmt7r\" (UniqueName: \"kubernetes.io/projected/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-kube-api-access-gmt7r\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.562863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.562863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.562863 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.562848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-root\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.621847 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.621812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.664020 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.663985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-root\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664149 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-sys\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664149 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66158722-15b9-4014-93ac-aa874e0540b8-metrics-client-ca\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664149 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664113 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-sys\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664149 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-root\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.664372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-textfile\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-wtmp\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-tls\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpnn7\" (UniqueName: \"kubernetes.io/projected/66158722-15b9-4014-93ac-aa874e0540b8-kube-api-access-cpnn7\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664400 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-wtmp\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmt7r\" (UniqueName: \"kubernetes.io/projected/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-kube-api-access-gmt7r\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-textfile\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:08.664495 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:08.664663 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-tls podName:66158722-15b9-4014-93ac-aa874e0540b8 nodeName:}" failed. No retries permitted until 2026-07-01 16:33:09.164643175 +0000 UTC m=+271.740335457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-tls") pod "node-exporter-wbswv" (UID: "66158722-15b9-4014-93ac-aa874e0540b8") : secret "node-exporter-tls" not found Jul 01 16:33:08.664690 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.664672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66158722-15b9-4014-93ac-aa874e0540b8-metrics-client-ca\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.665171 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.665009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.665463 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.665435 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.666884 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.666863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.666997 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.666943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.667257 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.667239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.675533 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.675509 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpnn7\" (UniqueName: \"kubernetes.io/projected/66158722-15b9-4014-93ac-aa874e0540b8-kube-api-access-cpnn7\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:08.675652 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.675633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmt7r\" (UniqueName: \"kubernetes.io/projected/56441fd9-bb6c-44b2-9b26-f6e0f6e01c81-kube-api-access-gmt7r\") pod \"openshift-state-metrics-57f99c8b49-dp4ht\" (UID: \"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.690344 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.690314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5mzn" event={"ID":"ca677b7e-ba0f-4446-a123-d0bf18b83970","Type":"ContainerStarted","Data":"ee157b02dbc20535d6d02d54f9d614f67f4149778d045d351d660005719c8016"} Jul 01 16:33:08.707032 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.706982 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k5mzn" podStartSLOduration=33.933968498 podStartE2EDuration="42.706937336s" totalImagesPullingTime="8.772968838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:32:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:08.706294116 +0000 UTC m=+271.281986406" watchObservedRunningTime="2026-07-01 16:33:08.706937336 +0000 UTC m=+271.282629626" Jul 01 16:33:08.766730 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.766680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.801449 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.801367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" Jul 01 16:33:08.829682 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.829651 2562 patch_prober.go:28] interesting pod/image-registry-949b496c7-pc67d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 16:33:08.829840 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.829706 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-949b496c7-pc67d" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:33:08.870342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.870309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:08.935855 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:08.935815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht"] Jul 01 16:33:08.937925 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:08.937897 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56441fd9_bb6c_44b2_9b26_f6e0f6e01c81.slice/crio-1413c08f1b1e21b4a4bd7c887817b20eed9c1b7325d660843cfab1860247dd94 WatchSource:0}: Error finding container 1413c08f1b1e21b4a4bd7c887817b20eed9c1b7325d660843cfab1860247dd94: Status 404 returned error can't find the container with id 1413c08f1b1e21b4a4bd7c887817b20eed9c1b7325d660843cfab1860247dd94 Jul 01 16:33:09.108058 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.108018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:09.168398 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.168357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-tls\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:09.170864 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.170828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66158722-15b9-4014-93ac-aa874e0540b8-node-exporter-tls\") pod \"node-exporter-wbswv\" (UID: \"66158722-15b9-4014-93ac-aa874e0540b8\") " pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:09.207934 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.207899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:09.309839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.309744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:09.439227 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.439191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wbswv" Jul 01 16:33:09.452872 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:09.452844 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66158722_15b9_4014_93ac_aa874e0540b8.slice/crio-9cd0b7ed329232db5088a313b39d36fc31b6b310aa4b9d9454d7d2ed1e034e75 WatchSource:0}: Error finding container 9cd0b7ed329232db5088a313b39d36fc31b6b310aa4b9d9454d7d2ed1e034e75: Status 404 returned error can't find the container with id 9cd0b7ed329232db5088a313b39d36fc31b6b310aa4b9d9454d7d2ed1e034e75 Jul 01 16:33:09.481848 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.481812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:09.569250 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.569157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:09.696440 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.696402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" event={"ID":"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81","Type":"ContainerStarted","Data":"c6994d68f3d2ff47ff4a3070990096ce2adf74344e6e6a7353e4ff367b61c4bc"} Jul 01 16:33:09.696645 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.696503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" event={"ID":"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81","Type":"ContainerStarted","Data":"c288e7e4f9d16d2f80e51cea406255febfeb1fd89c774d3b173bae5225175582"} Jul 01 16:33:09.696645 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.696538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" event={"ID":"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81","Type":"ContainerStarted","Data":"1413c08f1b1e21b4a4bd7c887817b20eed9c1b7325d660843cfab1860247dd94"} Jul 01 16:33:09.697889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.697852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wbswv" event={"ID":"66158722-15b9-4014-93ac-aa874e0540b8","Type":"ContainerStarted","Data":"9cd0b7ed329232db5088a313b39d36fc31b6b310aa4b9d9454d7d2ed1e034e75"} Jul 01 16:33:09.879954 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:09.879858 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:10.703924 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:10.703884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" event={"ID":"56441fd9-bb6c-44b2-9b26-f6e0f6e01c81","Type":"ContainerStarted","Data":"165a6e2474eab0bc74fd91ebaac44974174d51287bd9f5dc290f5b50f0d456fb"} Jul 01 16:33:10.705530 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:10.705502 2562 generic.go:356] "Generic (PLEG): container finished" podID="66158722-15b9-4014-93ac-aa874e0540b8" containerID="1eb041debec751536e061455833a778fb9df4af195fe5c8802c2169a026e4496" exitCode=0 Jul 01 16:33:10.705650 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:10.705565 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wbswv" event={"ID":"66158722-15b9-4014-93ac-aa874e0540b8","Type":"ContainerDied","Data":"1eb041debec751536e061455833a778fb9df4af195fe5c8802c2169a026e4496"} Jul 01 16:33:10.722130 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:10.722077 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-dp4ht" podStartSLOduration=1.645876218 podStartE2EDuration="2.722058243s" totalImagesPullingTime="1.076182025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:10.720290495 +0000 UTC m=+273.295982832" watchObservedRunningTime="2026-07-01 16:33:10.722058243 +0000 UTC m=+273.297750533" Jul 01 16:33:11.454973 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.454934 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:11.555564 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.555532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:11.711337 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.711249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wbswv" event={"ID":"66158722-15b9-4014-93ac-aa874e0540b8","Type":"ContainerStarted","Data":"7749c59641eb38c615353afa3fd224594a72dcdb13b0c65de4bb987e2c8a8149"} Jul 01 16:33:11.711337 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.711314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wbswv" event={"ID":"66158722-15b9-4014-93ac-aa874e0540b8","Type":"ContainerStarted","Data":"70be336c346b0b553fa097266dcfef4f286ba810b954535ffd80955751040732"} Jul 01 16:33:11.740535 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.740447 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wbswv" podStartSLOduration=2.719568116 podStartE2EDuration="3.740429331s" totalImagesPullingTime="944.28493ms" totalInitContainerRuntime="76.576285ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:11.737544806 +0000 UTC m=+274.313237097" watchObservedRunningTime="2026-07-01 16:33:11.740429331 +0000 UTC m=+274.316121622" Jul 01 16:33:11.783454 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.783409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:11.880731 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.880698 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:11.993323 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.993231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:11.993323 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.993304 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:11.994687 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.994659 2562 patch_prober.go:28] interesting pod/console-6c85f6fbbc-d5xn8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jul 01 16:33:11.994793 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:11.994718 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c85f6fbbc-d5xn8" podUID="9ab45318-673d-4fa6-8898-2db456a1d11f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jul 01 16:33:12.259376 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:12.259281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:12.359644 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:12.359605 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:13.279942 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:13.279913 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:13.376398 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:13.376367 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:13.479541 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:13.479508 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:13.844712 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:13.844669 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-949b496c7-pc67d" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerName="registry" containerID="cri-o://0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527" gracePeriod=30 Jul 01 16:33:14.087541 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.087515 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:33:14.212026 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.211990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlz7x\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-kube-api-access-xlz7x\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212075 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df00faf7-1ce5-45b6-926a-7f22babaf6ac-ca-trust-extracted\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212136 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-trusted-ca\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212175 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-image-registry-private-configuration\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212202 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-bound-sa-token\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212231 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-installation-pull-secrets\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212255 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212288 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-certificates\") pod \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\" (UID: \"df00faf7-1ce5-45b6-926a-7f22babaf6ac\") " Jul 01 16:33:14.212697 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.212661 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:33:14.213232 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.213136 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:33:14.214749 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.214719 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-kube-api-access-xlz7x" (OuterVolumeSpecName: "kube-api-access-xlz7x") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "kube-api-access-xlz7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:33:14.214872 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.214769 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:33:14.215081 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.215066 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:33:14.215222 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.215204 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:33:14.215303 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.215277 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:33:14.221127 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.221097 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df00faf7-1ce5-45b6-926a-7f22babaf6ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "df00faf7-1ce5-45b6-926a-7f22babaf6ac" (UID: "df00faf7-1ce5-45b6-926a-7f22babaf6ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:33:14.313694 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313653 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df00faf7-1ce5-45b6-926a-7f22babaf6ac-ca-trust-extracted\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.313694 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313690 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-trusted-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.314110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313705 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-image-registry-private-configuration\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.314110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313718 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-bound-sa-token\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.314110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313730 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df00faf7-1ce5-45b6-926a-7f22babaf6ac-installation-pull-secrets\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.314110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313740 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.314110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313751 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df00faf7-1ce5-45b6-926a-7f22babaf6ac-registry-certificates\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.314110 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.313762 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlz7x\" (UniqueName: \"kubernetes.io/projected/df00faf7-1ce5-45b6-926a-7f22babaf6ac-kube-api-access-xlz7x\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:14.696016 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.695975 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:33:14.696383 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.696361 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerName="registry" Jul 01 16:33:14.696383 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.696382 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerName="registry" Jul 01 16:33:14.696597 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.696435 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerName="registry" Jul 01 16:33:14.701998 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.701975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.705980 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.705758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 16:33:14.706269 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706169 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 16:33:14.706269 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 16:33:14.706428 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706270 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 16:33:14.706428 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706348 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 16:33:14.706428 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706398 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 16:33:14.706606 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706471 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-55q2449dfqfmk\"" Jul 01 16:33:14.706828 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706795 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 16:33:14.706906 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706853 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 16:33:14.706906 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706871 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 16:33:14.707034 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.706999 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 16:33:14.707497 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.707261 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-92l5k\"" Jul 01 16:33:14.707497 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.707345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 16:33:14.707497 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.707379 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 16:33:14.707497 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.707442 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 16:33:14.707684 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.707535 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 16:33:14.708921 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.708903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 16:33:14.713997 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.713966 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:33:14.715953 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.715922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:14.724432 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.724399 2562 generic.go:356] "Generic (PLEG): container finished" podID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" containerID="0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527" exitCode=0 Jul 01 16:33:14.724628 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.724516 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-949b496c7-pc67d" Jul 01 16:33:14.724628 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.724518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-949b496c7-pc67d" event={"ID":"df00faf7-1ce5-45b6-926a-7f22babaf6ac","Type":"ContainerDied","Data":"0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527"} Jul 01 16:33:14.724628 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.724575 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-949b496c7-pc67d" event={"ID":"df00faf7-1ce5-45b6-926a-7f22babaf6ac","Type":"ContainerDied","Data":"fb5fc3d9c712036e5b936071895038099c5fe2463147b488a892b5c0647fab05"} Jul 01 16:33:14.724628 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.724601 2562 scope.go:117] "RemoveContainer" containerID="0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527" Jul 01 16:33:14.734381 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.734359 2562 scope.go:117] "RemoveContainer" containerID="0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527" Jul 01 16:33:14.734743 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:14.734718 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527\": container with ID starting with 0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527 not found: ID does not exist" containerID="0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527" Jul 01 16:33:14.734805 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.734753 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527"} err="failed to get container status \"0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527\": rpc error: code = NotFound desc = could not find container \"0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527\": container with ID starting with 0bfa99e4a1ba6912f383120ea96843d5f500881bf6b62f835c2582d014236527 not found: ID does not exist" Jul 01 16:33:14.763427 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.763383 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-949b496c7-pc67d"] Jul 01 16:33:14.768962 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.768931 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-949b496c7-pc67d"] Jul 01 16:33:14.818530 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqkm\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-kube-api-access-xxqkm\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.818982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819066 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.818983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819066 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.819023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819066 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.819050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819152 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.819079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819152 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.819118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819210 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.819175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.819210 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.819197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.865254 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.865219 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c85f6fbbc-d5xn8"] Jul 01 16:33:14.892964 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.892925 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9cb4bd4b-njgjg"] Jul 01 16:33:14.897437 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.897408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:14.905133 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.905095 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9cb4bd4b-njgjg"] Jul 01 16:33:14.906252 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.906124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 16:33:14.920104 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqkm\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-kube-api-access-xxqkm\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.920686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.921184 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.921184 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.921184 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.921184 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.920963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.922570 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.922538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.923131 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.923105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.923430 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.923409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.923770 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.923746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.924360 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.924331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.925181 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.925150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.926021 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.925544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.926021 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.925587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.926021 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.925977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.928789 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.928769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.928945 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.928825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.929069 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.928825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.929069 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.929003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.929291 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.929268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.929723 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.929698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.929918 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.929890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.930844 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.930824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:14.931236 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:14.931219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqkm\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-kube-api-access-xxqkm\") pod \"prometheus-k8s-0\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:15.014422 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.014328 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:15.021922 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.021891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd9zl\" (UniqueName: \"kubernetes.io/projected/273483c3-8ba3-4154-88dc-2987915f7e7f-kube-api-access-qd9zl\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.022011 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.021942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-oauth-config\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.022056 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.022039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-serving-cert\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.022104 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.022087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-service-ca\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.022185 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.022165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-trusted-ca-bundle\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.022223 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.022201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-console-config\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.022223 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.022217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-oauth-serving-cert\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-serving-cert\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-service-ca\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-trusted-ca-bundle\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-console-config\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-oauth-serving-cert\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd9zl\" (UniqueName: \"kubernetes.io/projected/273483c3-8ba3-4154-88dc-2987915f7e7f-kube-api-access-qd9zl\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.123912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.123836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-oauth-config\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.125079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.125024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-oauth-serving-cert\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.125217 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.125116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-console-config\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.125217 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.125167 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-service-ca\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.125881 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.125852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-trusted-ca-bundle\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.126714 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.126691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-oauth-config\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.130705 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.130396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-serving-cert\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.133366 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.133337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd9zl\" (UniqueName: \"kubernetes.io/projected/273483c3-8ba3-4154-88dc-2987915f7e7f-kube-api-access-qd9zl\") pod \"console-7c9cb4bd4b-njgjg\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.175817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.175782 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:33:15.179811 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:15.179784 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdaab4e_ad20_4f78_9681_de097d65f8b6.slice/crio-7804aab77e69255ec3181b2d3b072b897311c92296297c65849584d9da823d32 WatchSource:0}: Error finding container 7804aab77e69255ec3181b2d3b072b897311c92296297c65849584d9da823d32: Status 404 returned error can't find the container with id 7804aab77e69255ec3181b2d3b072b897311c92296297c65849584d9da823d32 Jul 01 16:33:15.209535 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.209497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:15.345597 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.345569 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9cb4bd4b-njgjg"] Jul 01 16:33:15.347927 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:15.347903 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273483c3_8ba3_4154_88dc_2987915f7e7f.slice/crio-d3814a34417bb9b11e578819d7e4dbf2f7757534f7ddf5f519e1a161b9432b05 WatchSource:0}: Error finding container d3814a34417bb9b11e578819d7e4dbf2f7757534f7ddf5f519e1a161b9432b05: Status 404 returned error can't find the container with id d3814a34417bb9b11e578819d7e4dbf2f7757534f7ddf5f519e1a161b9432b05 Jul 01 16:33:15.732423 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.732386 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9cb4bd4b-njgjg" event={"ID":"273483c3-8ba3-4154-88dc-2987915f7e7f","Type":"ContainerStarted","Data":"109aab50d744f2a41b025ecaf95783275594f5b834e77768fa1dcc6d70296fd3"} Jul 01 16:33:15.732642 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.732447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9cb4bd4b-njgjg" event={"ID":"273483c3-8ba3-4154-88dc-2987915f7e7f","Type":"ContainerStarted","Data":"d3814a34417bb9b11e578819d7e4dbf2f7757534f7ddf5f519e1a161b9432b05"} Jul 01 16:33:15.733536 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.733515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"7804aab77e69255ec3181b2d3b072b897311c92296297c65849584d9da823d32"} Jul 01 16:33:15.753987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.753928 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9cb4bd4b-njgjg" podStartSLOduration=1.753910301 podStartE2EDuration="1.753910301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:15.7532033 +0000 UTC m=+278.328895601" watchObservedRunningTime="2026-07-01 16:33:15.753910301 +0000 UTC m=+278.329602590" Jul 01 16:33:15.857380 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:15.857344 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df00faf7-1ce5-45b6-926a-7f22babaf6ac" path="/var/lib/kubelet/pods/df00faf7-1ce5-45b6-926a-7f22babaf6ac/volumes" Jul 01 16:33:16.739659 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:16.739627 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" exitCode=0 Jul 01 16:33:16.739980 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:16.739712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} Jul 01 16:33:20.762784 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:20.762686 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} Jul 01 16:33:20.762784 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:20.762754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} Jul 01 16:33:21.059601 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:21.059510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:21.159376 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:21.159341 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:22.777292 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:22.777259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} Jul 01 16:33:22.777612 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:22.777348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} Jul 01 16:33:23.784667 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:23.784632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} Jul 01 16:33:23.785030 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:23.784696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerStarted","Data":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} Jul 01 16:33:23.813370 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:23.813312 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.615536697 podStartE2EDuration="9.813296417s" totalImagesPullingTime="7.179386617s" totalInitContainerRuntime="18.373103ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:33:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:23.81128133 +0000 UTC m=+286.386973620" watchObservedRunningTime="2026-07-01 16:33:23.813296417 +0000 UTC m=+286.388988706" Jul 01 16:33:24.338322 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:24.338275 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-757ql" podUID="1cf5670e-8038-4292-99c6-5a1e6f802583" Jul 01 16:33:24.788059 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:24.788014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-757ql" Jul 01 16:33:25.015212 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.015177 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:33:25.113314 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.113200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:25.210588 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.210552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:25.210780 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.210609 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:25.211730 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.211705 2562 patch_prober.go:28] interesting pod/console-7c9cb4bd4b-njgjg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 01 16:33:25.211858 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.211762 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c9cb4bd4b-njgjg" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 01 16:33:25.417549 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:25.417452 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:27.850296 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:27.850259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:33:27.853194 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:27.853172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf5670e-8038-4292-99c6-5a1e6f802583-metrics-tls\") pod \"dns-default-757ql\" (UID: \"1cf5670e-8038-4292-99c6-5a1e6f802583\") " pod="openshift-dns/dns-default-757ql" Jul 01 16:33:28.091384 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:28.091355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2lss\"" Jul 01 16:33:28.099503 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:28.099460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-757ql" Jul 01 16:33:28.237873 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:28.237848 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-757ql"] Jul 01 16:33:28.240396 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:33:28.240365 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf5670e_8038_4292_99c6_5a1e6f802583.slice/crio-720a88f37893220d394dc53df4931642059ec745e2d9a17f03e025f15a298967 WatchSource:0}: Error finding container 720a88f37893220d394dc53df4931642059ec745e2d9a17f03e025f15a298967: Status 404 returned error can't find the container with id 720a88f37893220d394dc53df4931642059ec745e2d9a17f03e025f15a298967 Jul 01 16:33:28.804440 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:28.804397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-757ql" event={"ID":"1cf5670e-8038-4292-99c6-5a1e6f802583","Type":"ContainerStarted","Data":"720a88f37893220d394dc53df4931642059ec745e2d9a17f03e025f15a298967"} Jul 01 16:33:30.467834 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:30.467796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:30.523756 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:30.523721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:30.817447 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:30.817352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-757ql" event={"ID":"1cf5670e-8038-4292-99c6-5a1e6f802583","Type":"ContainerStarted","Data":"efaa66c96240a783f0d556338f7361924efd4bda0b09e740259c1864795f8f21"} Jul 01 16:33:30.817447 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:30.817405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-757ql" event={"ID":"1cf5670e-8038-4292-99c6-5a1e6f802583","Type":"ContainerStarted","Data":"d823b9e32d23a732407fc5345fa0f5374f1dd36da88581d46af9980386b1dcea"} Jul 01 16:33:30.817714 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:30.817495 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-757ql" Jul 01 16:33:30.834955 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:30.834901 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-757ql" podStartSLOduration=252.140952627 podStartE2EDuration="4m13.834860439s" totalImagesPullingTime="1.693907812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:33:30.833883646 +0000 UTC m=+293.409575951" watchObservedRunningTime="2026-07-01 16:33:30.834860439 +0000 UTC m=+293.410552728" Jul 01 16:33:32.829876 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:32.829788 2562 generic.go:356] "Generic (PLEG): container finished" podID="24621ea3-50ce-4c35-a4a4-87fe0b950a08" containerID="01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594" exitCode=1 Jul 01 16:33:32.829876 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:32.829861 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" event={"ID":"24621ea3-50ce-4c35-a4a4-87fe0b950a08","Type":"ContainerDied","Data":"01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594"} Jul 01 16:33:32.830322 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:32.829951 2562 scope.go:117] "RemoveContainer" containerID="799be49ef6744e6a7119395084eae72ba9a8f63d8b12a064dab92f3c6f0bd447" Jul 01 16:33:32.830322 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:32.830222 2562 scope.go:117] "RemoveContainer" containerID="01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594" Jul 01 16:33:32.830443 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:32.830423 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-544ff89d76-sp6cx_open-cluster-management-agent-addon(24621ea3-50ce-4c35-a4a4-87fe0b950a08)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" podUID="24621ea3-50ce-4c35-a4a4-87fe0b950a08" Jul 01 16:33:33.373673 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:33.373620 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:33:33.834797 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:33.834770 2562 scope.go:117] "RemoveContainer" containerID="01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594" Jul 01 16:33:33.835171 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:33.834931 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-544ff89d76-sp6cx_open-cluster-management-agent-addon(24621ea3-50ce-4c35-a4a4-87fe0b950a08)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" podUID="24621ea3-50ce-4c35-a4a4-87fe0b950a08" Jul 01 16:33:35.209967 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:35.209924 2562 patch_prober.go:28] interesting pod/console-7c9cb4bd4b-njgjg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 01 16:33:35.210434 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:35.209983 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c9cb4bd4b-njgjg" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 01 16:33:37.791174 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.791149 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:33:37.791778 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.791755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:33:37.794753 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.794729 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:33:37.795195 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.795176 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:33:37.802761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.802739 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 16:33:37.818176 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.818146 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:33:37.818617 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:37.818603 2562 scope.go:117] "RemoveContainer" containerID="01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594" Jul 01 16:33:37.818779 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:37.818760 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-544ff89d76-sp6cx_open-cluster-management-agent-addon(24621ea3-50ce-4c35-a4a4-87fe0b950a08)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" podUID="24621ea3-50ce-4c35-a4a4-87fe0b950a08" Jul 01 16:33:39.890270 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:39.890203 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c85f6fbbc-d5xn8" podUID="9ab45318-673d-4fa6-8898-2db456a1d11f" containerName="console" containerID="cri-o://f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4" gracePeriod=15 Jul 01 16:33:40.244606 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:40.244567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:40.346714 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:40.346681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:40.825161 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:40.825127 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-757ql" Jul 01 16:33:41.527395 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.527367 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:41.569608 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.569495 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-oauth-config\") pod \"9ab45318-673d-4fa6-8898-2db456a1d11f\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " Jul 01 16:33:41.569608 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.569564 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-console-config\") pod \"9ab45318-673d-4fa6-8898-2db456a1d11f\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " Jul 01 16:33:41.569608 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.569596 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br79p\" (UniqueName: \"kubernetes.io/projected/9ab45318-673d-4fa6-8898-2db456a1d11f-kube-api-access-br79p\") pod \"9ab45318-673d-4fa6-8898-2db456a1d11f\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " Jul 01 16:33:41.569608 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.569617 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-serving-cert\") pod \"9ab45318-673d-4fa6-8898-2db456a1d11f\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " Jul 01 16:33:41.569938 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.569636 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-oauth-serving-cert\") pod \"9ab45318-673d-4fa6-8898-2db456a1d11f\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " Jul 01 16:33:41.569938 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.569664 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-service-ca\") pod \"9ab45318-673d-4fa6-8898-2db456a1d11f\" (UID: \"9ab45318-673d-4fa6-8898-2db456a1d11f\") " Jul 01 16:33:41.570063 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.570025 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-console-config" (OuterVolumeSpecName: "console-config") pod "9ab45318-673d-4fa6-8898-2db456a1d11f" (UID: "9ab45318-673d-4fa6-8898-2db456a1d11f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:33:41.570120 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.570092 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ab45318-673d-4fa6-8898-2db456a1d11f" (UID: "9ab45318-673d-4fa6-8898-2db456a1d11f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:33:41.570169 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.570126 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ab45318-673d-4fa6-8898-2db456a1d11f" (UID: "9ab45318-673d-4fa6-8898-2db456a1d11f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:33:41.572077 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.572049 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ab45318-673d-4fa6-8898-2db456a1d11f" (UID: "9ab45318-673d-4fa6-8898-2db456a1d11f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:33:41.572365 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.572345 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ab45318-673d-4fa6-8898-2db456a1d11f" (UID: "9ab45318-673d-4fa6-8898-2db456a1d11f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:33:41.572438 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.572359 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab45318-673d-4fa6-8898-2db456a1d11f-kube-api-access-br79p" (OuterVolumeSpecName: "kube-api-access-br79p") pod "9ab45318-673d-4fa6-8898-2db456a1d11f" (UID: "9ab45318-673d-4fa6-8898-2db456a1d11f"). InnerVolumeSpecName "kube-api-access-br79p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:33:41.670839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.670788 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-oauth-serving-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:41.670839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.670835 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-service-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:41.670839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.670846 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-oauth-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:41.670839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.670855 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ab45318-673d-4fa6-8898-2db456a1d11f-console-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:41.671131 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.670865 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br79p\" (UniqueName: \"kubernetes.io/projected/9ab45318-673d-4fa6-8898-2db456a1d11f-kube-api-access-br79p\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:41.671131 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.670874 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab45318-673d-4fa6-8898-2db456a1d11f-console-serving-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:33:41.867726 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.867693 2562 generic.go:356] "Generic (PLEG): container finished" podID="9ab45318-673d-4fa6-8898-2db456a1d11f" containerID="f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4" exitCode=0 Jul 01 16:33:41.867871 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.867735 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85f6fbbc-d5xn8" Jul 01 16:33:41.867871 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.867745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85f6fbbc-d5xn8" event={"ID":"9ab45318-673d-4fa6-8898-2db456a1d11f","Type":"ContainerDied","Data":"f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4"} Jul 01 16:33:41.867871 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.867792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85f6fbbc-d5xn8" event={"ID":"9ab45318-673d-4fa6-8898-2db456a1d11f","Type":"ContainerDied","Data":"5f8e246855273f5cc83f1c5adc8a8b0f83573d4773d39e05f9d9a9401152828e"} Jul 01 16:33:41.867871 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.867819 2562 scope.go:117] "RemoveContainer" containerID="f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4" Jul 01 16:33:41.877801 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.877753 2562 scope.go:117] "RemoveContainer" containerID="f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4" Jul 01 16:33:41.878158 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:33:41.878133 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4\": container with ID starting with f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4 not found: ID does not exist" containerID="f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4" Jul 01 16:33:41.878206 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.878171 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4"} err="failed to get container status \"f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4\": rpc error: code = NotFound desc = could not find container \"f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4\": container with ID starting with f4da34232e982348c21eb973c64244384fe95f134e90205139c8c20ca20c12b4 not found: ID does not exist" Jul 01 16:33:41.883307 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.883279 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c85f6fbbc-d5xn8"] Jul 01 16:33:41.886591 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:41.886564 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c85f6fbbc-d5xn8"] Jul 01 16:33:42.609803 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:42.609771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:43.751036 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:43.751001 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:43.803288 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:43.803254 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:43.853309 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:43.853275 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab45318-673d-4fa6-8898-2db456a1d11f" path="/var/lib/kubelet/pods/9ab45318-673d-4fa6-8898-2db456a1d11f/volumes" Jul 01 16:33:45.213999 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.213968 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:45.217720 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.217697 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:33:45.368915 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.368878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:45.415706 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.415664 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:45.476836 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.476747 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:45.718082 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.718041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:45.818887 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.818796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:45.870580 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:45.870547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:46.766906 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:46.766868 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:46.868139 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:46.868105 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:49.355312 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:49.355272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:49.456255 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:49.456222 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:49.849633 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:49.849603 2562 scope.go:117] "RemoveContainer" containerID="01ae0b9a1a015011a1ab7d43b8566899955ed2d1d6356ae62939a6f9491a0594" Jul 01 16:33:50.904191 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:50.904157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" event={"ID":"24621ea3-50ce-4c35-a4a4-87fe0b950a08","Type":"ContainerStarted","Data":"036b47edb88e02f51509e3303321664d64996c6aaefd4fafc90d88200a50532f"} Jul 01 16:33:50.904672 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:50.904535 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:33:50.906087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:50.906064 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-544ff89d76-sp6cx" Jul 01 16:33:51.909396 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:51.909358 2562 generic.go:356] "Generic (PLEG): container finished" podID="44eb7107-93a6-4610-b5ee-c8558778abdb" containerID="a5361e2478801bb39fd2198dc81c203f0e229a1ee580ed5f35e246fa222b2ab1" exitCode=0 Jul 01 16:33:51.909867 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:51.909436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" event={"ID":"44eb7107-93a6-4610-b5ee-c8558778abdb","Type":"ContainerDied","Data":"a5361e2478801bb39fd2198dc81c203f0e229a1ee580ed5f35e246fa222b2ab1"} Jul 01 16:33:51.909867 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:51.909846 2562 scope.go:117] "RemoveContainer" containerID="a5361e2478801bb39fd2198dc81c203f0e229a1ee580ed5f35e246fa222b2ab1" Jul 01 16:33:52.831362 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:52.831325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:52.915517 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:52.915460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-6fk5q" event={"ID":"44eb7107-93a6-4610-b5ee-c8558778abdb","Type":"ContainerStarted","Data":"f1b6e5b01c2c804da52ce014b2ff04e75da853a8d42ba7e9af8ef5f2916ee4b4"} Jul 01 16:33:52.931921 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:52.931889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:53.529503 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:53.529448 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-757ql_1cf5670e-8038-4292-99c6-5a1e6f802583/dns/0.log" Jul 01 16:33:53.728927 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:53.728892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-757ql_1cf5670e-8038-4292-99c6-5a1e6f802583/kube-rbac-proxy/0.log" Jul 01 16:33:54.328595 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:54.328567 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8k45g_4809f2d1-90dc-4499-9559-d31551ade25c/dns-node-resolver/0.log" Jul 01 16:33:54.928761 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:54.928735 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f84f844d5-d96l8_1aaa5207-ca6c-4a4f-9132-af836d1da051/router/0.log" Jul 01 16:33:55.529318 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:55.529278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqxxd_e96aa6e7-359b-4778-bbb5-a255b3418abe/serve-healthcheck-canary/0.log" Jul 01 16:33:55.778417 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:55.778377 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:56.228577 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:56.228544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:33:56.752245 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:33:56.752206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:04.291300 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:04.291204 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:04.389753 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:04.389712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:04.492422 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:04.492379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:10.716582 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:10.716546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:10.765404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:10.765362 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:12.014536 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:12.014498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:12.111981 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:12.111942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:15.014692 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:15.014651 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:15.031585 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:15.031558 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:16.021407 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:16.021376 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:17.110519 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:17.110450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:17.163385 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:17.163351 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:27.012513 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:27.012460 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:27.064615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:27.064570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:27.871700 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:27.871664 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:28.119854 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:28.119806 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:33.077309 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077275 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:34:33.077817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077602 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy" containerID="cri-o://2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" gracePeriod=600 Jul 01 16:34:33.077817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077596 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="prometheus" containerID="cri-o://1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" gracePeriod=600 Jul 01 16:34:33.077817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077648 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" gracePeriod=600 Jul 01 16:34:33.077817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077681 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="thanos-sidecar" containerID="cri-o://6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" gracePeriod=600 Jul 01 16:34:33.077817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077733 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-web" containerID="cri-o://07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" gracePeriod=600 Jul 01 16:34:33.077817 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.077765 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="config-reloader" containerID="cri-o://ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" gracePeriod=600 Jul 01 16:34:33.346882 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.346854 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:33.418522 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418470 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418541 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config-out\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418571 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-metrics-client-certs\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418606 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418632 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-db\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418667 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-serving-certs-ca-bundle\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418693 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-tls-assets\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.418719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418723 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-1\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418749 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-kube-rbac-proxy\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418775 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-web-config\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418805 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-2\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418846 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-grpc-tls\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418869 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-kubelet-serving-ca-bundle\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418894 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-0\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418930 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-thanos-prometheus-http-client-file\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxqkm\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-kube-api-access-xxqkm\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.418998 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419052 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-tls\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419085 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-metrics-client-ca\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419100 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419123 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-trusted-ca-bundle\") pod \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\" (UID: \"3cdaab4e-ad20-4f78-9681-de097d65f8b6\") " Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419182 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419384 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419410 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419429 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.419810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419553 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.420206 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.419867 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:34:33.421919 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.421805 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.421919 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.421860 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.421919 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.421875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.422398 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.422347 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:34:33.422512 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.422407 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config-out" (OuterVolumeSpecName: "config-out") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:34:33.423231 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.423108 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.423231 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.423168 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.423231 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.423208 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.423915 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.423886 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.424417 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.424385 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:34:33.424805 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.424771 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.424986 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.424959 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.425238 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.425216 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-kube-api-access-xxqkm" (OuterVolumeSpecName: "kube-api-access-xxqkm") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "kube-api-access-xxqkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:34:33.425365 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.425326 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config" (OuterVolumeSpecName: "config") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.435144 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.435095 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-web-config" (OuterVolumeSpecName: "web-config") pod "3cdaab4e-ad20-4f78-9681-de097d65f8b6" (UID: "3cdaab4e-ad20-4f78-9681-de097d65f8b6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:34:33.520254 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520207 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520254 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520244 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-metrics-client-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520254 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520254 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520254 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520267 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520277 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config-out\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520285 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-metrics-client-certs\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520296 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520305 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-db\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520313 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520321 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-tls-assets\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520329 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-kube-rbac-proxy\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520359 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-web-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520367 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-secret-grpc-tls\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520379 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520387 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cdaab4e-ad20-4f78-9681-de097d65f8b6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520396 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520404 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxqkm\" (UniqueName: \"kubernetes.io/projected/3cdaab4e-ad20-4f78-9681-de097d65f8b6-kube-api-access-xxqkm\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:33.520556 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:33.520412 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cdaab4e-ad20-4f78-9681-de097d65f8b6-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:34:34.077015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.076974 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" exitCode=0 Jul 01 16:34:34.077015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077003 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" exitCode=0 Jul 01 16:34:34.077015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077013 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" exitCode=0 Jul 01 16:34:34.077015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077019 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" exitCode=0 Jul 01 16:34:34.077015 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077025 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" exitCode=0 Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077031 2562 generic.go:356] "Generic (PLEG): container finished" podID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" exitCode=0 Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077069 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077181 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} Jul 01 16:34:34.077735 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.077238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cdaab4e-ad20-4f78-9681-de097d65f8b6","Type":"ContainerDied","Data":"7804aab77e69255ec3181b2d3b072b897311c92296297c65849584d9da823d32"} Jul 01 16:34:34.085753 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.085733 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.100856 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.100804 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:34:34.105627 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.105459 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:34:34.105710 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.105650 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.113159 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.113140 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.120506 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.120461 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.127931 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.127908 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.131725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.131699 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:34:34.131988 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.131973 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="config-reloader" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.131991 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="config-reloader" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132003 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132013 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132024 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-thanos" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132033 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-thanos" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132052 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab45318-673d-4fa6-8898-2db456a1d11f" containerName="console" Jul 01 16:34:34.132062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132060 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab45318-673d-4fa6-8898-2db456a1d11f" containerName="console" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132070 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="thanos-sidecar" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132078 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="thanos-sidecar" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132087 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="prometheus" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132096 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="prometheus" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132111 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="init-config-reloader" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132119 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="init-config-reloader" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132130 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-web" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132138 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-web" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132224 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132235 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab45318-673d-4fa6-8898-2db456a1d11f" containerName="console" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132245 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-web" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132253 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="prometheus" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132263 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="thanos-sidecar" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132271 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="config-reloader" Jul 01 16:34:34.132439 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.132281 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" containerName="kube-rbac-proxy-thanos" Jul 01 16:34:34.136124 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.136059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.136223 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.136160 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.138820 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.138799 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 16:34:34.138943 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.138802 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 16:34:34.139292 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139272 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 16:34:34.139404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139297 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-92l5k\"" Jul 01 16:34:34.139404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139329 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 16:34:34.139404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 16:34:34.139404 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 16:34:34.139648 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139409 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 16:34:34.139700 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.139674 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 16:34:34.140443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.140290 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 16:34:34.140443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.140336 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 16:34:34.140443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.140340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-55q2449dfqfmk\"" Jul 01 16:34:34.140443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.140355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 16:34:34.140443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.140364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 16:34:34.140986 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.140972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 16:34:34.143433 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.143412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 16:34:34.145530 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.145511 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 16:34:34.145766 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.145747 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.146040 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.146022 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.146094 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146049 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} err="failed to get container status \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" Jul 01 16:34:34.146094 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146068 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.146335 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.146312 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.146399 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146346 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} err="failed to get container status \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" Jul 01 16:34:34.146399 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146381 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.146630 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.146615 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.146689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146636 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} err="failed to get container status \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" Jul 01 16:34:34.146689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146649 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.146890 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.146874 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.146935 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146895 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} err="failed to get container status \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" Jul 01 16:34:34.146935 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.146910 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.147149 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.147130 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.147235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.147152 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} err="failed to get container status \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" Jul 01 16:34:34.147235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.147166 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.147395 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.147379 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.147433 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.147400 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} err="failed to get container status \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" Jul 01 16:34:34.147433 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.147413 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.147722 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:34:34.147700 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.147864 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.147727 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} err="failed to get container status \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" Jul 01 16:34:34.147864 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.147747 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.148063 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.148002 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} err="failed to get container status \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" Jul 01 16:34:34.148063 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.148025 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.148332 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.148311 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} err="failed to get container status \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" Jul 01 16:34:34.148332 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.148331 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.148856 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.148721 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} err="failed to get container status \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" Jul 01 16:34:34.148856 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.148747 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.149055 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149035 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} err="failed to get container status \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" Jul 01 16:34:34.149055 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149053 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.149303 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149280 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} err="failed to get container status \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" Jul 01 16:34:34.149378 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149306 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.149626 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149605 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} err="failed to get container status \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" Jul 01 16:34:34.149700 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149628 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.149900 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149881 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} err="failed to get container status \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" Jul 01 16:34:34.149961 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.149901 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.150083 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150068 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} err="failed to get container status \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" Jul 01 16:34:34.150142 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150083 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.150257 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150241 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} err="failed to get container status \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" Jul 01 16:34:34.150318 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150256 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.150450 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150434 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} err="failed to get container status \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" Jul 01 16:34:34.150543 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150449 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.150719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150702 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} err="failed to get container status \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" Jul 01 16:34:34.150781 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150719 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.150937 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150917 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:34:34.150992 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150948 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} err="failed to get container status \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" Jul 01 16:34:34.150992 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.150965 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.151187 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151166 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} err="failed to get container status \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" Jul 01 16:34:34.151235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151189 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.151431 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151412 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} err="failed to get container status \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" Jul 01 16:34:34.151497 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151432 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.151671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151653 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} err="failed to get container status \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" Jul 01 16:34:34.151738 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151674 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.151933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151917 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} err="failed to get container status \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" Jul 01 16:34:34.151998 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.151935 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.152168 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152147 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} err="failed to get container status \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" Jul 01 16:34:34.152372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152169 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.152435 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152420 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} err="failed to get container status \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" Jul 01 16:34:34.152510 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152436 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.152708 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152688 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} err="failed to get container status \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" Jul 01 16:34:34.152781 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152709 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.152927 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152911 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} err="failed to get container status \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" Jul 01 16:34:34.152927 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.152926 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.153113 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153097 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} err="failed to get container status \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" Jul 01 16:34:34.153216 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153114 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.153323 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153304 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} err="failed to get container status \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" Jul 01 16:34:34.153323 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153322 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.153974 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153640 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} err="failed to get container status \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" Jul 01 16:34:34.153974 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153674 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.153974 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153923 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} err="failed to get container status \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" Jul 01 16:34:34.153974 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.153944 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.154228 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.154207 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} err="failed to get container status \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" Jul 01 16:34:34.154286 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.154230 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.154538 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.154511 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} err="failed to get container status \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" Jul 01 16:34:34.154629 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.154538 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.154825 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.154803 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} err="failed to get container status \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" Jul 01 16:34:34.154825 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.154824 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.155095 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155074 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} err="failed to get container status \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" Jul 01 16:34:34.155146 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155097 2562 scope.go:117] "RemoveContainer" containerID="491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41" Jul 01 16:34:34.155335 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155318 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41"} err="failed to get container status \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": rpc error: code = NotFound desc = could not find container \"491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41\": container with ID starting with 491c2c7baa64d835fa11dcf738788694099375954fe840de890458d1e41f5a41 not found: ID does not exist" Jul 01 16:34:34.155384 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155335 2562 scope.go:117] "RemoveContainer" containerID="2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619" Jul 01 16:34:34.155586 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155569 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619"} err="failed to get container status \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": rpc error: code = NotFound desc = could not find container \"2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619\": container with ID starting with 2382d0e4f04d14486371fdbaca3a9dd91af8a22c494dad547fef34502577c619 not found: ID does not exist" Jul 01 16:34:34.155638 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155587 2562 scope.go:117] "RemoveContainer" containerID="07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c" Jul 01 16:34:34.155807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155790 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c"} err="failed to get container status \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": rpc error: code = NotFound desc = could not find container \"07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c\": container with ID starting with 07850419c23d056b2537604539f0da2f96528616d1d64720b100ed7446b6074c not found: ID does not exist" Jul 01 16:34:34.155807 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.155807 2562 scope.go:117] "RemoveContainer" containerID="6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a" Jul 01 16:34:34.156050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156031 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a"} err="failed to get container status \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": rpc error: code = NotFound desc = could not find container \"6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a\": container with ID starting with 6f3d5e06d37a2bc365fd7266556eb340d7156decc1a2fd1bc7f6ed1e4243734a not found: ID does not exist" Jul 01 16:34:34.156050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156050 2562 scope.go:117] "RemoveContainer" containerID="ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda" Jul 01 16:34:34.156265 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156251 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda"} err="failed to get container status \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": rpc error: code = NotFound desc = could not find container \"ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda\": container with ID starting with ed2c43d5540e0e74cc694909c1d054b1df89659612cd46fdaf9e300ba3bc4bda not found: ID does not exist" Jul 01 16:34:34.156310 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156266 2562 scope.go:117] "RemoveContainer" containerID="1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924" Jul 01 16:34:34.156509 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156489 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924"} err="failed to get container status \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": rpc error: code = NotFound desc = could not find container \"1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924\": container with ID starting with 1b14597fe8279c6ef0cb6656b1e897a0410b354c656f70ca3ec2cd9c66fd5924 not found: ID does not exist" Jul 01 16:34:34.156509 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156508 2562 scope.go:117] "RemoveContainer" containerID="16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8" Jul 01 16:34:34.156742 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.156725 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8"} err="failed to get container status \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": rpc error: code = NotFound desc = could not find container \"16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8\": container with ID starting with 16b657f6c44b5b65c4590a3b3444e7536af10b04b1ee625e508acec8fa276ee8 not found: ID does not exist" Jul 01 16:34:34.224912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.224872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5zzr\" (UniqueName: \"kubernetes.io/projected/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-kube-api-access-h5zzr\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.224929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.224957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.224977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.224999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-config\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225087 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.225508 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.225399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326354 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326354 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zzr\" (UniqueName: \"kubernetes.io/projected/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-kube-api-access-h5zzr\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326908 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.326908 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-config\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.326994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327151 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327526 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327899 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.327948 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.327917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.329801 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.330276 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.330326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.330413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.330565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.330714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.330889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.330886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.331356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.331041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.331356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.331106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.331356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.331346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.331670 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.331647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.333035 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.333000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.333250 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.333234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.333370 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.333353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-config\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.333730 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.333715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.334666 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.334639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zzr\" (UniqueName: \"kubernetes.io/projected/93194267-0b8c-40e1-92a2-5fc2aed0ed6d-kube-api-access-h5zzr\") pod \"prometheus-k8s-0\" (UID: \"93194267-0b8c-40e1-92a2-5fc2aed0ed6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.447858 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.447824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:34.589672 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:34.589537 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:34:34.592263 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:34:34.592234 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93194267_0b8c_40e1_92a2_5fc2aed0ed6d.slice/crio-713917c76b79b3f652ed3e0031d09a80f6038e693221ebd02d7af2a751deada9 WatchSource:0}: Error finding container 713917c76b79b3f652ed3e0031d09a80f6038e693221ebd02d7af2a751deada9: Status 404 returned error can't find the container with id 713917c76b79b3f652ed3e0031d09a80f6038e693221ebd02d7af2a751deada9 Jul 01 16:34:35.082199 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:35.082167 2562 generic.go:356] "Generic (PLEG): container finished" podID="93194267-0b8c-40e1-92a2-5fc2aed0ed6d" containerID="0781608c23297ada67c85ddab5f4d0b60b9964b88fd597060e35fb4e03b5b3c1" exitCode=0 Jul 01 16:34:35.082689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:35.082266 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerDied","Data":"0781608c23297ada67c85ddab5f4d0b60b9964b88fd597060e35fb4e03b5b3c1"} Jul 01 16:34:35.082689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:35.082364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"713917c76b79b3f652ed3e0031d09a80f6038e693221ebd02d7af2a751deada9"} Jul 01 16:34:35.853274 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:35.853240 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdaab4e-ad20-4f78-9681-de097d65f8b6" path="/var/lib/kubelet/pods/3cdaab4e-ad20-4f78-9681-de097d65f8b6/volumes" Jul 01 16:34:36.090298 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.090261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"7f82eade0a3cb1b72cce37cbf97b42e7c374f03b046ff33927437448f5b57bc8"} Jul 01 16:34:36.090693 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.090328 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"11ef992443481cafae112360f685a8afc0736d25cfedc407b3b6c469e49e0c35"} Jul 01 16:34:36.090693 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.090363 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"18cd9c853fa1e58fc023bee23e456857b6fdc89d85748c64e7cff78b25d7a1d5"} Jul 01 16:34:36.090693 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.090388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"286f478cebd6430dd953f10cafa8a6a48a95c7d1dcf9b27dff90d274d2aa3c85"} Jul 01 16:34:36.090693 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.090414 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"d97610d5334626a82ab715c1677fb8201120e8faf60be29408dac14c6f5f4bd1"} Jul 01 16:34:36.090693 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.090436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93194267-0b8c-40e1-92a2-5fc2aed0ed6d","Type":"ContainerStarted","Data":"1d87f2f6273056926e01c0c4e7827f8b47f8120e1620b697fcd4c8c42465f724"} Jul 01 16:34:36.119355 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.119247 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.099987718 podStartE2EDuration="2.119227538s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.23982ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:34:36.117399413 +0000 UTC m=+358.693091704" watchObservedRunningTime="2026-07-01 16:34:36.119227538 +0000 UTC m=+358.694919827" Jul 01 16:34:36.802969 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.802936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:36.851023 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.850972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:36.949832 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:36.949790 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:37.051595 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:37.051555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:37.566689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:37.566652 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:39.448634 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:39.448581 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:34:42.009883 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:42.009843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:42.194108 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:42.194067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:48.076093 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:48.076060 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9cb4bd4b-njgjg"] Jul 01 16:34:48.166538 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:48.166506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:34:48.279615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:34:48.279576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:13.104983 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.104938 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c9cb4bd4b-njgjg" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerName="console" containerID="cri-o://109aab50d744f2a41b025ecaf95783275594f5b834e77768fa1dcc6d70296fd3" gracePeriod=15 Jul 01 16:35:13.233466 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.233430 2562 generic.go:356] "Generic (PLEG): container finished" podID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerID="109aab50d744f2a41b025ecaf95783275594f5b834e77768fa1dcc6d70296fd3" exitCode=0 Jul 01 16:35:13.233466 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.233460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9cb4bd4b-njgjg" event={"ID":"273483c3-8ba3-4154-88dc-2987915f7e7f","Type":"ContainerDied","Data":"109aab50d744f2a41b025ecaf95783275594f5b834e77768fa1dcc6d70296fd3"} Jul 01 16:35:13.360308 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.360247 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:35:13.456839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.456800 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-console-config\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.456850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd9zl\" (UniqueName: \"kubernetes.io/projected/273483c3-8ba3-4154-88dc-2987915f7e7f-kube-api-access-qd9zl\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.456887 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-serving-cert\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.456933 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-service-ca\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.456958 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-oauth-config\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.456988 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-oauth-serving-cert\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.457045 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-trusted-ca-bundle\") pod \"273483c3-8ba3-4154-88dc-2987915f7e7f\" (UID: \"273483c3-8ba3-4154-88dc-2987915f7e7f\") " Jul 01 16:35:13.457420 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.457210 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-console-config" (OuterVolumeSpecName: "console-config") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:35:13.457550 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.457524 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:35:13.457614 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.457563 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:35:13.457614 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.457572 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:35:13.459301 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.459271 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273483c3-8ba3-4154-88dc-2987915f7e7f-kube-api-access-qd9zl" (OuterVolumeSpecName: "kube-api-access-qd9zl") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "kube-api-access-qd9zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:35:13.459711 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.459690 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:35:13.459794 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.459705 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "273483c3-8ba3-4154-88dc-2987915f7e7f" (UID: "273483c3-8ba3-4154-88dc-2987915f7e7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:35:13.557912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557871 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-trusted-ca-bundle\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:13.557912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557902 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-console-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:13.557912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557913 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd9zl\" (UniqueName: \"kubernetes.io/projected/273483c3-8ba3-4154-88dc-2987915f7e7f-kube-api-access-qd9zl\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:13.557912 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557923 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-serving-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:13.558186 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557931 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-service-ca\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:13.558186 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557941 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273483c3-8ba3-4154-88dc-2987915f7e7f-console-oauth-config\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:13.558186 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:13.557949 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273483c3-8ba3-4154-88dc-2987915f7e7f-oauth-serving-cert\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:35:14.238840 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:14.238807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9cb4bd4b-njgjg" event={"ID":"273483c3-8ba3-4154-88dc-2987915f7e7f","Type":"ContainerDied","Data":"d3814a34417bb9b11e578819d7e4dbf2f7757534f7ddf5f519e1a161b9432b05"} Jul 01 16:35:14.238840 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:14.238829 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9cb4bd4b-njgjg" Jul 01 16:35:14.239353 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:14.238867 2562 scope.go:117] "RemoveContainer" containerID="109aab50d744f2a41b025ecaf95783275594f5b834e77768fa1dcc6d70296fd3" Jul 01 16:35:14.258130 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:14.258101 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9cb4bd4b-njgjg"] Jul 01 16:35:14.261794 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:14.261769 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c9cb4bd4b-njgjg"] Jul 01 16:35:15.857592 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:15.854417 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" path="/var/lib/kubelet/pods/273483c3-8ba3-4154-88dc-2987915f7e7f/volumes" Jul 01 16:35:22.803765 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:22.803718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:34.448771 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:34.448732 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:35:34.464931 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:34.464903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:35:35.335664 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:35.335637 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:35:42.943166 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:42.943131 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:42.997336 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:42.997300 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:50.927028 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:50.926981 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:51.220274 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:51.220231 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:54.916682 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:54.916639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:35:54.977580 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:35:54.977547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:01.508062 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:01.507946 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:01.608280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:01.608239 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:01.679768 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:01.679726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:12.021924 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:12.021877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:12.123413 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:12.123371 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:12.297211 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:12.297093 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:33.428868 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:33.428832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:34.290422 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:34.290392 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:36:59.997732 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:36:59.997695 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:00.822067 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:00.822034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:04.511719 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:04.511646 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:04.689612 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:04.689578 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:06.744551 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:06.744517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:06.854129 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:06.854090 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:07.029647 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:07.029540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:07.163911 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:07.163875 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:10.230666 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:10.230627 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:10.327268 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:10.327221 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:10.635507 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:10.635386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:12.022699 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:12.022670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:12.077468 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:12.077425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:17.414811 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.414772 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gsbvs"] Jul 01 16:37:17.415268 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.415193 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerName="console" Jul 01 16:37:17.415268 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.415210 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerName="console" Jul 01 16:37:17.415378 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.415290 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="273483c3-8ba3-4154-88dc-2987915f7e7f" containerName="console" Jul 01 16:37:17.418183 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.418162 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.421729 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.421684 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 16:37:17.421876 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.421750 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 16:37:17.428103 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.428077 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gsbvs"] Jul 01 16:37:17.449396 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.449368 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:17.474432 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.474398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/cccd3ea8-f3dc-4f91-a00d-0acd6863352d-kube-api-access-gf4th\") pod \"cert-manager-59c77684cc-gsbvs\" (UID: \"cccd3ea8-f3dc-4f91-a00d-0acd6863352d\") " pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.474432 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.474432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cccd3ea8-f3dc-4f91-a00d-0acd6863352d-bound-sa-token\") pod \"cert-manager-59c77684cc-gsbvs\" (UID: \"cccd3ea8-f3dc-4f91-a00d-0acd6863352d\") " pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.575349 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.575298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/cccd3ea8-f3dc-4f91-a00d-0acd6863352d-kube-api-access-gf4th\") pod \"cert-manager-59c77684cc-gsbvs\" (UID: \"cccd3ea8-f3dc-4f91-a00d-0acd6863352d\") " pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.575349 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.575346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cccd3ea8-f3dc-4f91-a00d-0acd6863352d-bound-sa-token\") pod \"cert-manager-59c77684cc-gsbvs\" (UID: \"cccd3ea8-f3dc-4f91-a00d-0acd6863352d\") " pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.584085 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.584055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cccd3ea8-f3dc-4f91-a00d-0acd6863352d-bound-sa-token\") pod \"cert-manager-59c77684cc-gsbvs\" (UID: \"cccd3ea8-f3dc-4f91-a00d-0acd6863352d\") " pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.584220 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.584150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4th\" (UniqueName: \"kubernetes.io/projected/cccd3ea8-f3dc-4f91-a00d-0acd6863352d-kube-api-access-gf4th\") pod \"cert-manager-59c77684cc-gsbvs\" (UID: \"cccd3ea8-f3dc-4f91-a00d-0acd6863352d\") " pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.742927 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.742890 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gsbvs" Jul 01 16:37:17.875938 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.875863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gsbvs"] Jul 01 16:37:17.878201 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:37:17.878177 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcccd3ea8_f3dc_4f91_a00d_0acd6863352d.slice/crio-b6aac975b3359bf88a055861968b4a02cc365aede1554659f810bc48788929ca WatchSource:0}: Error finding container b6aac975b3359bf88a055861968b4a02cc365aede1554659f810bc48788929ca: Status 404 returned error can't find the container with id b6aac975b3359bf88a055861968b4a02cc365aede1554659f810bc48788929ca Jul 01 16:37:17.879962 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:17.879945 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:37:18.701586 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:18.701544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gsbvs" event={"ID":"cccd3ea8-f3dc-4f91-a00d-0acd6863352d","Type":"ContainerStarted","Data":"b6aac975b3359bf88a055861968b4a02cc365aede1554659f810bc48788929ca"} Jul 01 16:37:19.448806 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:19.448704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:19.549515 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:19.549459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:21.717072 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:21.717030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gsbvs" event={"ID":"cccd3ea8-f3dc-4f91-a00d-0acd6863352d","Type":"ContainerStarted","Data":"4ff62c51e2847b98e2e9864acee74781d09808f0d0c082e7d4c4a50cd60812e9"} Jul 01 16:37:21.734192 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:21.734142 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gsbvs" podStartSLOduration=1.678949437 podStartE2EDuration="4.734125739s" totalImagesPullingTime="3.055176302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:37:21.733497058 +0000 UTC m=+524.309189356" watchObservedRunningTime="2026-07-01 16:37:21.734125739 +0000 UTC m=+524.309818029" Jul 01 16:37:25.487304 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:25.487241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:31.690228 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:31.690130 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:31.790872 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:31.790837 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:40.358020 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:40.357973 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:40.460834 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:40.460790 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:41.398976 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:41.398931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:42.059642 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:42.059607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:45.714766 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:45.714733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:45.768686 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:45.768635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:50.312555 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.312516 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:50.361280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.361245 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6975944b75-wg56h"] Jul 01 16:37:50.364304 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.364281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.368568 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.368542 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dkpwl\"" Jul 01 16:37:50.368716 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.368555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 16:37:50.368871 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.368856 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:37:50.368956 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.368891 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 16:37:50.368956 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.368894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 16:37:50.368956 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.368911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 16:37:50.374946 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.374922 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6975944b75-wg56h"] Jul 01 16:37:50.413738 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.413699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:50.445834 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.445776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f12f438-58c7-4686-8b94-ea1348873a19-manager-config\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.445834 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.445830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f12f438-58c7-4686-8b94-ea1348873a19-metrics-cert\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.446050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.445859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nbzw\" (UniqueName: \"kubernetes.io/projected/5f12f438-58c7-4686-8b94-ea1348873a19-kube-api-access-7nbzw\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.446050 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.445904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f12f438-58c7-4686-8b94-ea1348873a19-cert\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.546849 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.546805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f12f438-58c7-4686-8b94-ea1348873a19-manager-config\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.546849 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.546853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f12f438-58c7-4686-8b94-ea1348873a19-metrics-cert\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.546849 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.546874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nbzw\" (UniqueName: \"kubernetes.io/projected/5f12f438-58c7-4686-8b94-ea1348873a19-kube-api-access-7nbzw\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.547116 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.547025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f12f438-58c7-4686-8b94-ea1348873a19-cert\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.547542 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.547522 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f12f438-58c7-4686-8b94-ea1348873a19-manager-config\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.549590 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.549572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f12f438-58c7-4686-8b94-ea1348873a19-cert\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.549753 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.549732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f12f438-58c7-4686-8b94-ea1348873a19-metrics-cert\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.555385 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.555359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nbzw\" (UniqueName: \"kubernetes.io/projected/5f12f438-58c7-4686-8b94-ea1348873a19-kube-api-access-7nbzw\") pod \"lws-controller-manager-6975944b75-wg56h\" (UID: \"5f12f438-58c7-4686-8b94-ea1348873a19\") " pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.674289 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.674196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:50.812614 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.812585 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6975944b75-wg56h"] Jul 01 16:37:50.814864 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:37:50.814836 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f12f438_58c7_4686_8b94_ea1348873a19.slice/crio-a58beb09e20d29c6f496299bee84e0ecd909070d2a093ef087f3ccdf29d1eabb WatchSource:0}: Error finding container a58beb09e20d29c6f496299bee84e0ecd909070d2a093ef087f3ccdf29d1eabb: Status 404 returned error can't find the container with id a58beb09e20d29c6f496299bee84e0ecd909070d2a093ef087f3ccdf29d1eabb Jul 01 16:37:50.835931 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:50.835893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" event={"ID":"5f12f438-58c7-4686-8b94-ea1348873a19","Type":"ContainerStarted","Data":"a58beb09e20d29c6f496299bee84e0ecd909070d2a093ef087f3ccdf29d1eabb"} Jul 01 16:37:52.985142 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:52.985101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:53.086643 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:53.086604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:53.854128 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:53.854047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" event={"ID":"5f12f438-58c7-4686-8b94-ea1348873a19","Type":"ContainerStarted","Data":"68f89ab5c483bf5103fe206eeebc8cc5b24f16a5307a2c5c10c93093edefaef9"} Jul 01 16:37:53.854128 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:53.854099 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:37:53.870662 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:53.870605 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" podStartSLOduration=1.2367588409999999 podStartE2EDuration="3.870589755s" totalImagesPullingTime="2.633830914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:37:53.869377332 +0000 UTC m=+556.445069622" watchObservedRunningTime="2026-07-01 16:37:53.870589755 +0000 UTC m=+556.446282044" Jul 01 16:37:54.848280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:54.848240 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:54.939641 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:54.939602 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:55.480831 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.480801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:55.761144 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.761043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:55.862520 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.862464 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:55.910684 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.910650 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68"] Jul 01 16:37:55.914866 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.914834 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:55.918252 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.918227 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 16:37:55.918397 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.918378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7vdqb\"" Jul 01 16:37:55.918472 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.918399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 16:37:55.918666 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.918652 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 16:37:55.918732 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.918709 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 16:37:55.933592 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.933561 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68"] Jul 01 16:37:55.994590 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.994552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e6c11a44-981c-49a5-b536-e422fc1c6a30-manifests\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:55.994590 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.994586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e6c11a44-981c-49a5-b536-e422fc1c6a30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:55.994828 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.994701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c11a44-981c-49a5-b536-e422fc1c6a30-tmp\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:55.994828 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.994746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6c11a44-981c-49a5-b536-e422fc1c6a30-webhook-cert\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:55.994828 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:55.994778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8jgr\" (UniqueName: \"kubernetes.io/projected/e6c11a44-981c-49a5-b536-e422fc1c6a30-kube-api-access-g8jgr\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.018587 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.018495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:56.096022 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.095981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c11a44-981c-49a5-b536-e422fc1c6a30-tmp\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.096022 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.096022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6c11a44-981c-49a5-b536-e422fc1c6a30-webhook-cert\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.096236 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.096046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8jgr\" (UniqueName: \"kubernetes.io/projected/e6c11a44-981c-49a5-b536-e422fc1c6a30-kube-api-access-g8jgr\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.096236 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.096101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e6c11a44-981c-49a5-b536-e422fc1c6a30-manifests\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.096236 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.096117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e6c11a44-981c-49a5-b536-e422fc1c6a30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.096507 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.096447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e6c11a44-981c-49a5-b536-e422fc1c6a30-manifests\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.098544 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.098513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c11a44-981c-49a5-b536-e422fc1c6a30-tmp\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.098684 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.098653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e6c11a44-981c-49a5-b536-e422fc1c6a30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.098748 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.098720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6c11a44-981c-49a5-b536-e422fc1c6a30-webhook-cert\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.105615 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.105595 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8jgr\" (UniqueName: \"kubernetes.io/projected/e6c11a44-981c-49a5-b536-e422fc1c6a30-kube-api-access-g8jgr\") pod \"opendatahub-operator-controller-manager-9bbcfc888-w2l68\" (UID: \"e6c11a44-981c-49a5-b536-e422fc1c6a30\") " pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.225541 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.225461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:37:56.372949 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.372925 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68"] Jul 01 16:37:56.375026 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:37:56.375002 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c11a44_981c_49a5_b536_e422fc1c6a30.slice/crio-ced651df2004ec5cdc607f2393b2023599ba1c5a04c2dd46dbb9bc4e2f1d18ed WatchSource:0}: Error finding container ced651df2004ec5cdc607f2393b2023599ba1c5a04c2dd46dbb9bc4e2f1d18ed: Status 404 returned error can't find the container with id ced651df2004ec5cdc607f2393b2023599ba1c5a04c2dd46dbb9bc4e2f1d18ed Jul 01 16:37:56.865684 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:56.865651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" event={"ID":"e6c11a44-981c-49a5-b536-e422fc1c6a30","Type":"ContainerStarted","Data":"ced651df2004ec5cdc607f2393b2023599ba1c5a04c2dd46dbb9bc4e2f1d18ed"} Jul 01 16:37:58.375363 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:58.375328 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:59.259414 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:59.259381 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:37:59.880067 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:37:59.880032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" event={"ID":"e6c11a44-981c-49a5-b536-e422fc1c6a30","Type":"ContainerStarted","Data":"a4d42dcf3dde2732a524e77962136c795740d8a61f17e5185247839ef69f0179"} Jul 01 16:38:00.885811 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:00.885770 2562 generic.go:356] "Generic (PLEG): container finished" podID="e6c11a44-981c-49a5-b536-e422fc1c6a30" containerID="a4d42dcf3dde2732a524e77962136c795740d8a61f17e5185247839ef69f0179" exitCode=0 Jul 01 16:38:00.886215 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:00.885856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" event={"ID":"e6c11a44-981c-49a5-b536-e422fc1c6a30","Type":"ContainerDied","Data":"a4d42dcf3dde2732a524e77962136c795740d8a61f17e5185247839ef69f0179"} Jul 01 16:38:01.892393 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:01.892358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" event={"ID":"e6c11a44-981c-49a5-b536-e422fc1c6a30","Type":"ContainerStarted","Data":"a3f90ae38de0069572125da9cebd9517858bd87c4d46daa0216786594674102e"} Jul 01 16:38:01.892844 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:01.892498 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:38:01.920525 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:01.920453 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" podStartSLOduration=2.668106218 podStartE2EDuration="6.920434188s" totalImagesPullingTime="3.29688042s" totalInitContainerRuntime="955.44755ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:37:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:01.919318535 +0000 UTC m=+564.495010845" watchObservedRunningTime="2026-07-01 16:38:01.920434188 +0000 UTC m=+564.496126545" Jul 01 16:38:04.858640 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:04.858607 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6975944b75-wg56h" Jul 01 16:38:12.899271 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:12.899235 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9bbcfc888-w2l68" Jul 01 16:38:14.462880 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:14.462847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:14.569514 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:14.569458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:15.097721 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:15.097663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:15.210980 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:15.210944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:15.335375 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:15.335343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:15.792383 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:15.792335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:15.884247 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:15.884185 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:16.093655 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:16.093539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:16.303329 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:16.303289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:16.450709 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:16.450669 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:16.544776 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:16.544742 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:17.455907 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:17.455868 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:22.241755 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.241714 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k"] Jul 01 16:38:22.249822 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.249799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.252770 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.252745 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 16:38:22.253094 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.253075 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 16:38:22.253352 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.253335 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 16:38:22.253352 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.253344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v66gl\"" Jul 01 16:38:22.253514 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.253349 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 16:38:22.270889 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.270857 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k"] Jul 01 16:38:22.328517 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.328517 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dv72\" (UniqueName: \"kubernetes.io/projected/c5851aed-ddb6-480c-b881-7fdb6700b729-kube-api-access-2dv72\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.328781 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.328781 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.328781 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5851aed-ddb6-480c-b881-7fdb6700b729-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.328931 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.328931 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.328841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429372 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429588 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dv72\" (UniqueName: \"kubernetes.io/projected/c5851aed-ddb6-480c-b881-7fdb6700b729-kube-api-access-2dv72\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429588 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429717 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429717 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5851aed-ddb6-480c-b881-7fdb6700b729-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429717 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.429868 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.429735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.430254 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.430223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.432328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.432288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5851aed-ddb6-480c-b881-7fdb6700b729-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.432328 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.432305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.432587 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.432571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.432698 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.432676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.438096 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.438066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dv72\" (UniqueName: \"kubernetes.io/projected/c5851aed-ddb6-480c-b881-7fdb6700b729-kube-api-access-2dv72\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.438246 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.438216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5851aed-ddb6-480c-b881-7fdb6700b729-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6ss8k\" (UID: \"c5851aed-ddb6-480c-b881-7fdb6700b729\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.559769 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.559658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:22.735844 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.735799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k"] Jul 01 16:38:22.741217 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:38:22.741176 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5851aed_ddb6_480c_b881_7fdb6700b729.slice/crio-5fb101f6c6e8cd0cf2a3c93acd2ff0054bbbcdd4eeb56461c0f30eda6f6485f4 WatchSource:0}: Error finding container 5fb101f6c6e8cd0cf2a3c93acd2ff0054bbbcdd4eeb56461c0f30eda6f6485f4: Status 404 returned error can't find the container with id 5fb101f6c6e8cd0cf2a3c93acd2ff0054bbbcdd4eeb56461c0f30eda6f6485f4 Jul 01 16:38:22.978823 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:22.978787 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" event={"ID":"c5851aed-ddb6-480c-b881-7fdb6700b729","Type":"ContainerStarted","Data":"5fb101f6c6e8cd0cf2a3c93acd2ff0054bbbcdd4eeb56461c0f30eda6f6485f4"} Jul 01 16:38:23.025299 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:23.025265 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:23.128075 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:23.128039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:23.299140 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:23.299049 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:23.536963 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:23.536926 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:23.748544 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:23.748497 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:24.767033 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:24.767002 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:24.885565 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:24.885463 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:25.041334 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:25.041246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:25.449815 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:25.449767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:26.168390 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:26.168351 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:26.285594 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:26.285549 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:26.298768 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:26.298727 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 01 16:38:26.298893 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:26.298797 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 01 16:38:27.000367 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.000334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" event={"ID":"c5851aed-ddb6-480c-b881-7fdb6700b729","Type":"ContainerStarted","Data":"3d0666a26ebf0d5bf58d40b24eb904b39b81e4002e1e19efdfb61e624839b841"} Jul 01 16:38:27.000568 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.000502 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:27.002267 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.002236 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-6ss8k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 16:38:27.002440 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.002288 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" podUID="c5851aed-ddb6-480c-b881-7fdb6700b729" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:38:27.022901 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.022844 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" podStartSLOduration=1.467629342 podStartE2EDuration="5.02282632s" totalImagesPullingTime="3.555196978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:27.021022103 +0000 UTC m=+589.596714411" watchObservedRunningTime="2026-07-01 16:38:27.02282632 +0000 UTC m=+589.598518609" Jul 01 16:38:27.281982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.281903 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-9497df747-bhfqx"] Jul 01 16:38:27.286168 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.286145 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.289609 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.289584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 16:38:27.289742 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.289635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7brp2\"" Jul 01 16:38:27.299496 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.299446 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9497df747-bhfqx"] Jul 01 16:38:27.344495 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.344414 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:27.375492 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.375427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mlkc\" (UniqueName: \"kubernetes.io/projected/58727a69-525d-4041-b9c6-8d21ced1b366-kube-api-access-7mlkc\") pod \"dashboard-redirect-9497df747-bhfqx\" (UID: \"58727a69-525d-4041-b9c6-8d21ced1b366\") " pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.375689 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.375550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/58727a69-525d-4041-b9c6-8d21ced1b366-redirect-config\") pod \"dashboard-redirect-9497df747-bhfqx\" (UID: \"58727a69-525d-4041-b9c6-8d21ced1b366\") " pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.476706 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.476666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/58727a69-525d-4041-b9c6-8d21ced1b366-redirect-config\") pod \"dashboard-redirect-9497df747-bhfqx\" (UID: \"58727a69-525d-4041-b9c6-8d21ced1b366\") " pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.476887 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.476727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mlkc\" (UniqueName: \"kubernetes.io/projected/58727a69-525d-4041-b9c6-8d21ced1b366-kube-api-access-7mlkc\") pod \"dashboard-redirect-9497df747-bhfqx\" (UID: \"58727a69-525d-4041-b9c6-8d21ced1b366\") " pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.477472 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.477450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/58727a69-525d-4041-b9c6-8d21ced1b366-redirect-config\") pod \"dashboard-redirect-9497df747-bhfqx\" (UID: \"58727a69-525d-4041-b9c6-8d21ced1b366\") " pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.487559 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.487529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mlkc\" (UniqueName: \"kubernetes.io/projected/58727a69-525d-4041-b9c6-8d21ced1b366-kube-api-access-7mlkc\") pod \"dashboard-redirect-9497df747-bhfqx\" (UID: \"58727a69-525d-4041-b9c6-8d21ced1b366\") " pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.596576 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.596451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9497df747-bhfqx" Jul 01 16:38:27.746000 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:27.745969 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9497df747-bhfqx"] Jul 01 16:38:27.747263 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:38:27.747235 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58727a69_525d_4041_b9c6_8d21ced1b366.slice/crio-2c074a15ae967bc72e4ce4a24be894e7ff78cd4c3d8e9da61af0b578fc94b721 WatchSource:0}: Error finding container 2c074a15ae967bc72e4ce4a24be894e7ff78cd4c3d8e9da61af0b578fc94b721: Status 404 returned error can't find the container with id 2c074a15ae967bc72e4ce4a24be894e7ff78cd4c3d8e9da61af0b578fc94b721 Jul 01 16:38:28.008561 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:28.008524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9497df747-bhfqx" event={"ID":"58727a69-525d-4041-b9c6-8d21ced1b366","Type":"ContainerStarted","Data":"2c074a15ae967bc72e4ce4a24be894e7ff78cd4c3d8e9da61af0b578fc94b721"} Jul 01 16:38:28.009228 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:28.009205 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6ss8k" Jul 01 16:38:33.035121 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:33.035087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9497df747-bhfqx" event={"ID":"58727a69-525d-4041-b9c6-8d21ced1b366","Type":"ContainerStarted","Data":"7f7496c8128af75699191201c7c80cba10c34805e836549d9e9902f243b3d051"} Jul 01 16:38:33.054025 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:33.053969 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-9497df747-bhfqx" podStartSLOduration=1.263360374 podStartE2EDuration="6.053952665s" totalImagesPullingTime="4.790592291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:38:33.052319898 +0000 UTC m=+595.628012188" watchObservedRunningTime="2026-07-01 16:38:33.053952665 +0000 UTC m=+595.629644956" Jul 01 16:38:33.272883 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:33.272841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:33.331340 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:33.331244 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:38:37.823239 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:37.823210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:38:37.824745 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:37.824712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:38:37.826750 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:37.826729 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:38:37.828408 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:37.828388 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:38:58.311336 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:38:58.311297 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:01.628135 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:01.628043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:16.080035 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:16.079992 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:16.180756 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:16.180700 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:16.255948 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:16.255913 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:20.751460 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:20.751426 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.739134 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:41.739083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.798997 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:41.798966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:41.880643 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:41.880605 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:42.479227 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:42.479188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:45.268101 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:45.268060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:45.862886 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:45.862846 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:50.311410 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:50.311373 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:52.507220 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:52.507184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:52.768909 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:52.768813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:52.867643 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:52.867604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:52.926426 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:52.926386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.244751 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:55.244719 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:55.479965 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:55.479930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:56.903846 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:56.903807 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:58.494971 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:58.494931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:39:59.704801 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:39:59.704753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:01.679907 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:01.679864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:01.917216 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:01.917181 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:03.216243 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:03.216212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:03.316676 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:03.316642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:04.817742 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:04.817704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:05.153300 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:05.153216 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:06.274425 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:06.274383 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:06.374415 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:06.374382 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:13.182750 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:13.182709 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:13.285143 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:13.285096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:15.663163 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:15.663124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:15.758458 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:15.758426 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:16.189777 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.189739 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt"] Jul 01 16:40:16.192847 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.192824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.195920 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.195888 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:40:16.195920 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.195892 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bsgwz\"" Jul 01 16:40:16.196107 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.195955 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:40:16.205982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.205955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt"] Jul 01 16:40:16.336450 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.336416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eff45ce9-2674-4b16-8a03-e474973d7253-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9pfdt\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.336656 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.336463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4slxq\" (UniqueName: \"kubernetes.io/projected/eff45ce9-2674-4b16-8a03-e474973d7253-kube-api-access-4slxq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9pfdt\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.437742 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.437702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eff45ce9-2674-4b16-8a03-e474973d7253-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9pfdt\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.437922 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.437756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4slxq\" (UniqueName: \"kubernetes.io/projected/eff45ce9-2674-4b16-8a03-e474973d7253-kube-api-access-4slxq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9pfdt\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.438144 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.438123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eff45ce9-2674-4b16-8a03-e474973d7253-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9pfdt\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.446561 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.446455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4slxq\" (UniqueName: \"kubernetes.io/projected/eff45ce9-2674-4b16-8a03-e474973d7253-kube-api-access-4slxq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9pfdt\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.504076 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.504041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:16.649904 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:16.649878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt"] Jul 01 16:40:16.652443 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:40:16.652415 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff45ce9_2674_4b16_8a03_e474973d7253.slice/crio-d822dcc486361134aa25303dd926847ea06f96b71d3bf565d0c525ba96143950 WatchSource:0}: Error finding container d822dcc486361134aa25303dd926847ea06f96b71d3bf565d0c525ba96143950: Status 404 returned error can't find the container with id d822dcc486361134aa25303dd926847ea06f96b71d3bf565d0c525ba96143950 Jul 01 16:40:17.472869 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:17.472835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" event={"ID":"eff45ce9-2674-4b16-8a03-e474973d7253","Type":"ContainerStarted","Data":"d822dcc486361134aa25303dd926847ea06f96b71d3bf565d0c525ba96143950"} Jul 01 16:40:21.242290 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:21.242234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.302840 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:21.302801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.590529 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:21.590404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:21.648033 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:21.647983 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:22.498507 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:22.498448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" event={"ID":"eff45ce9-2674-4b16-8a03-e474973d7253","Type":"ContainerStarted","Data":"de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099"} Jul 01 16:40:22.498890 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:22.498628 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:22.518991 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:22.518926 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" podStartSLOduration=0.876915999 podStartE2EDuration="6.518908153s" totalImagesPullingTime="5.641992154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:40:22.517409567 +0000 UTC m=+705.093101876" watchObservedRunningTime="2026-07-01 16:40:22.518908153 +0000 UTC m=+705.094600445" Jul 01 16:40:25.651520 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:25.651463 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:26.252618 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:26.252588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:33.506140 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:33.506102 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:33.608108 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:33.608072 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:33.717142 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:33.717107 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:35.589206 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:35.589160 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:35.690725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:35.690689 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:45.518152 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.518106 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt"] Jul 01 16:40:45.518680 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.518383 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" podUID="eff45ce9-2674-4b16-8a03-e474973d7253" containerName="manager" containerID="cri-o://de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099" gracePeriod=10 Jul 01 16:40:45.769954 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.769888 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:45.888124 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.888089 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4slxq\" (UniqueName: \"kubernetes.io/projected/eff45ce9-2674-4b16-8a03-e474973d7253-kube-api-access-4slxq\") pod \"eff45ce9-2674-4b16-8a03-e474973d7253\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " Jul 01 16:40:45.888311 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.888141 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eff45ce9-2674-4b16-8a03-e474973d7253-extensions-socket-volume\") pod \"eff45ce9-2674-4b16-8a03-e474973d7253\" (UID: \"eff45ce9-2674-4b16-8a03-e474973d7253\") " Jul 01 16:40:45.888579 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.888544 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eff45ce9-2674-4b16-8a03-e474973d7253-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eff45ce9-2674-4b16-8a03-e474973d7253" (UID: "eff45ce9-2674-4b16-8a03-e474973d7253"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:40:45.890570 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.890543 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff45ce9-2674-4b16-8a03-e474973d7253-kube-api-access-4slxq" (OuterVolumeSpecName: "kube-api-access-4slxq") pod "eff45ce9-2674-4b16-8a03-e474973d7253" (UID: "eff45ce9-2674-4b16-8a03-e474973d7253"). InnerVolumeSpecName "kube-api-access-4slxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:40:45.989744 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.989711 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4slxq\" (UniqueName: \"kubernetes.io/projected/eff45ce9-2674-4b16-8a03-e474973d7253-kube-api-access-4slxq\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:40:45.989744 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:45.989739 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eff45ce9-2674-4b16-8a03-e474973d7253-extensions-socket-volume\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:40:46.603045 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.603012 2562 generic.go:356] "Generic (PLEG): container finished" podID="eff45ce9-2674-4b16-8a03-e474973d7253" containerID="de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099" exitCode=0 Jul 01 16:40:46.603441 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.603064 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" Jul 01 16:40:46.603441 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.603101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" event={"ID":"eff45ce9-2674-4b16-8a03-e474973d7253","Type":"ContainerDied","Data":"de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099"} Jul 01 16:40:46.603441 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.603155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt" event={"ID":"eff45ce9-2674-4b16-8a03-e474973d7253","Type":"ContainerDied","Data":"d822dcc486361134aa25303dd926847ea06f96b71d3bf565d0c525ba96143950"} Jul 01 16:40:46.603441 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.603178 2562 scope.go:117] "RemoveContainer" containerID="de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099" Jul 01 16:40:46.612165 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.612145 2562 scope.go:117] "RemoveContainer" containerID="de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099" Jul 01 16:40:46.612450 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:40:46.612431 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099\": container with ID starting with de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099 not found: ID does not exist" containerID="de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099" Jul 01 16:40:46.612540 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.612461 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099"} err="failed to get container status \"de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099\": rpc error: code = NotFound desc = could not find container \"de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099\": container with ID starting with de2461cc38c16c4872d9bdd5c8a69ae54a8fc0dfca693c92007f0243193c1099 not found: ID does not exist" Jul 01 16:40:46.630938 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.630900 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt"] Jul 01 16:40:46.636173 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:46.636143 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9pfdt"] Jul 01 16:40:47.854356 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:47.854319 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff45ce9-2674-4b16-8a03-e474973d7253" path="/var/lib/kubelet/pods/eff45ce9-2674-4b16-8a03-e474973d7253/volumes" Jul 01 16:40:49.880188 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:49.880152 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:50.077207 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:50.077175 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:40:52.372548 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:40:52.372507 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:04.389574 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.389540 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:04.389987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.389838 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff45ce9-2674-4b16-8a03-e474973d7253" containerName="manager" Jul 01 16:41:04.389987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.389853 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff45ce9-2674-4b16-8a03-e474973d7253" containerName="manager" Jul 01 16:41:04.389987 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.389968 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff45ce9-2674-4b16-8a03-e474973d7253" containerName="manager" Jul 01 16:41:04.392119 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.392098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.395582 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.395557 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:41:04.395695 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.395591 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccrsx\"" Jul 01 16:41:04.396360 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.396341 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:41:04.396465 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.396421 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 16:41:04.400976 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.400948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:04.402443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.402423 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:04.481458 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.481426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:04.489299 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.489265 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:04.552234 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.552198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3aca55ff-db48-4675-8a4d-277a20c6653b-config-file\") pod \"limitador-limitador-64c94fd64f-jlvq6\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.552427 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.552247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdx59\" (UniqueName: \"kubernetes.io/projected/3aca55ff-db48-4675-8a4d-277a20c6653b-kube-api-access-bdx59\") pod \"limitador-limitador-64c94fd64f-jlvq6\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.553840 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.553805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:04.653575 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.653472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdx59\" (UniqueName: \"kubernetes.io/projected/3aca55ff-db48-4675-8a4d-277a20c6653b-kube-api-access-bdx59\") pod \"limitador-limitador-64c94fd64f-jlvq6\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.653736 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.653588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3aca55ff-db48-4675-8a4d-277a20c6653b-config-file\") pod \"limitador-limitador-64c94fd64f-jlvq6\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.654284 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.654264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3aca55ff-db48-4675-8a4d-277a20c6653b-config-file\") pod \"limitador-limitador-64c94fd64f-jlvq6\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.661928 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.661899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdx59\" (UniqueName: \"kubernetes.io/projected/3aca55ff-db48-4675-8a4d-277a20c6653b-kube-api-access-bdx59\") pod \"limitador-limitador-64c94fd64f-jlvq6\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.703676 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.703643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:04.833387 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:04.833274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:04.835840 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:41:04.835814 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aca55ff_db48_4675_8a4d_277a20c6653b.slice/crio-45395f0541a627908e81894e68b13b76aab5dd29fc278cbc10bd88eb840de486 WatchSource:0}: Error finding container 45395f0541a627908e81894e68b13b76aab5dd29fc278cbc10bd88eb840de486: Status 404 returned error can't find the container with id 45395f0541a627908e81894e68b13b76aab5dd29fc278cbc10bd88eb840de486 Jul 01 16:41:05.197787 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:05.197745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:05.298148 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:05.298114 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:05.691057 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:05.690978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" event={"ID":"3aca55ff-db48-4675-8a4d-277a20c6653b","Type":"ContainerStarted","Data":"45395f0541a627908e81894e68b13b76aab5dd29fc278cbc10bd88eb840de486"} Jul 01 16:41:07.701917 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:07.701881 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" event={"ID":"3aca55ff-db48-4675-8a4d-277a20c6653b","Type":"ContainerStarted","Data":"631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b"} Jul 01 16:41:07.702329 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:07.702010 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:07.717159 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:07.717108 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" podStartSLOduration=0.996595898 podStartE2EDuration="3.71709155s" totalImagesPullingTime="2.720495652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:41:07.716491708 +0000 UTC m=+750.292183993" watchObservedRunningTime="2026-07-01 16:41:07.71709155 +0000 UTC m=+750.292783903" Jul 01 16:41:18.707679 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:18.707648 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:22.059245 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.059207 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:22.059705 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.059387 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" podUID="3aca55ff-db48-4675-8a4d-277a20c6653b" containerName="limitador" containerID="cri-o://631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b" gracePeriod=30 Jul 01 16:41:22.605598 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.605568 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:22.708219 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.708177 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3aca55ff-db48-4675-8a4d-277a20c6653b-config-file\") pod \"3aca55ff-db48-4675-8a4d-277a20c6653b\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " Jul 01 16:41:22.708219 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.708224 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdx59\" (UniqueName: \"kubernetes.io/projected/3aca55ff-db48-4675-8a4d-277a20c6653b-kube-api-access-bdx59\") pod \"3aca55ff-db48-4675-8a4d-277a20c6653b\" (UID: \"3aca55ff-db48-4675-8a4d-277a20c6653b\") " Jul 01 16:41:22.708589 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.708561 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aca55ff-db48-4675-8a4d-277a20c6653b-config-file" (OuterVolumeSpecName: "config-file") pod "3aca55ff-db48-4675-8a4d-277a20c6653b" (UID: "3aca55ff-db48-4675-8a4d-277a20c6653b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:41:22.710541 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.710514 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aca55ff-db48-4675-8a4d-277a20c6653b-kube-api-access-bdx59" (OuterVolumeSpecName: "kube-api-access-bdx59") pod "3aca55ff-db48-4675-8a4d-277a20c6653b" (UID: "3aca55ff-db48-4675-8a4d-277a20c6653b"). InnerVolumeSpecName "kube-api-access-bdx59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:41:22.774244 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.774211 2562 generic.go:356] "Generic (PLEG): container finished" podID="3aca55ff-db48-4675-8a4d-277a20c6653b" containerID="631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b" exitCode=0 Jul 01 16:41:22.774456 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.774259 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" Jul 01 16:41:22.774456 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.774266 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" event={"ID":"3aca55ff-db48-4675-8a4d-277a20c6653b","Type":"ContainerDied","Data":"631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b"} Jul 01 16:41:22.774456 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.774341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jlvq6" event={"ID":"3aca55ff-db48-4675-8a4d-277a20c6653b","Type":"ContainerDied","Data":"45395f0541a627908e81894e68b13b76aab5dd29fc278cbc10bd88eb840de486"} Jul 01 16:41:22.774456 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.774370 2562 scope.go:117] "RemoveContainer" containerID="631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b" Jul 01 16:41:22.783546 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.783525 2562 scope.go:117] "RemoveContainer" containerID="631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b" Jul 01 16:41:22.783833 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:41:22.783814 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b\": container with ID starting with 631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b not found: ID does not exist" containerID="631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b" Jul 01 16:41:22.783903 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.783845 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b"} err="failed to get container status \"631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b\": rpc error: code = NotFound desc = could not find container \"631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b\": container with ID starting with 631ee30a936eb9c2b54f21468550b79c57eab0d3d52af761b29739d6c078ef9b not found: ID does not exist" Jul 01 16:41:22.794577 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.794544 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:22.797999 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.797972 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jlvq6"] Jul 01 16:41:22.809551 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.809529 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3aca55ff-db48-4675-8a4d-277a20c6653b-config-file\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:41:22.809632 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:22.809553 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdx59\" (UniqueName: \"kubernetes.io/projected/3aca55ff-db48-4675-8a4d-277a20c6653b-kube-api-access-bdx59\") on node \"ip-10-0-135-32.ec2.internal\" DevicePath \"\"" Jul 01 16:41:23.854036 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:23.853993 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aca55ff-db48-4675-8a4d-277a20c6653b" path="/var/lib/kubelet/pods/3aca55ff-db48-4675-8a4d-277a20c6653b/volumes" Jul 01 16:41:28.370951 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.370914 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-s4pkg"] Jul 01 16:41:28.371438 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.371408 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aca55ff-db48-4675-8a4d-277a20c6653b" containerName="limitador" Jul 01 16:41:28.371438 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.371429 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aca55ff-db48-4675-8a4d-277a20c6653b" containerName="limitador" Jul 01 16:41:28.371592 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.371558 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aca55ff-db48-4675-8a4d-277a20c6653b" containerName="limitador" Jul 01 16:41:28.376279 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.376257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.379373 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.379345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 01 16:41:28.380656 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.380632 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s4pkg"] Jul 01 16:41:28.399781 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.399745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:28.454848 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.454809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/811c015f-caf8-4b87-bead-01069e5a9d69-data\") pod \"postgres-69fb4594cf-s4pkg\" (UID: \"811c015f-caf8-4b87-bead-01069e5a9d69\") " pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.455025 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.454937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4sf\" (UniqueName: \"kubernetes.io/projected/811c015f-caf8-4b87-bead-01069e5a9d69-kube-api-access-hg4sf\") pod \"postgres-69fb4594cf-s4pkg\" (UID: \"811c015f-caf8-4b87-bead-01069e5a9d69\") " pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.555994 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.555949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4sf\" (UniqueName: \"kubernetes.io/projected/811c015f-caf8-4b87-bead-01069e5a9d69-kube-api-access-hg4sf\") pod \"postgres-69fb4594cf-s4pkg\" (UID: \"811c015f-caf8-4b87-bead-01069e5a9d69\") " pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.556187 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.556013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/811c015f-caf8-4b87-bead-01069e5a9d69-data\") pod \"postgres-69fb4594cf-s4pkg\" (UID: \"811c015f-caf8-4b87-bead-01069e5a9d69\") " pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.556463 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.556443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/811c015f-caf8-4b87-bead-01069e5a9d69-data\") pod \"postgres-69fb4594cf-s4pkg\" (UID: \"811c015f-caf8-4b87-bead-01069e5a9d69\") " pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.564550 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.564524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4sf\" (UniqueName: \"kubernetes.io/projected/811c015f-caf8-4b87-bead-01069e5a9d69-kube-api-access-hg4sf\") pod \"postgres-69fb4594cf-s4pkg\" (UID: \"811c015f-caf8-4b87-bead-01069e5a9d69\") " pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.688569 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.688436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:28.822426 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:28.822401 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s4pkg"] Jul 01 16:41:28.824524 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:41:28.824465 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811c015f_caf8_4b87_bead_01069e5a9d69.slice/crio-5b07287a8975a7847e18642e11e8937891c90d553c998abbfe683acbf3aa4232 WatchSource:0}: Error finding container 5b07287a8975a7847e18642e11e8937891c90d553c998abbfe683acbf3aa4232: Status 404 returned error can't find the container with id 5b07287a8975a7847e18642e11e8937891c90d553c998abbfe683acbf3aa4232 Jul 01 16:41:29.813188 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:29.813147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s4pkg" event={"ID":"811c015f-caf8-4b87-bead-01069e5a9d69","Type":"ContainerStarted","Data":"5b07287a8975a7847e18642e11e8937891c90d553c998abbfe683acbf3aa4232"} Jul 01 16:41:31.824250 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:31.824217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s4pkg" event={"ID":"811c015f-caf8-4b87-bead-01069e5a9d69","Type":"ContainerStarted","Data":"0ac2c445e4d93fbf59f91ac81dbe6f7366d4d1bdc29059d7060d9f874289a433"} Jul 01 16:41:31.824786 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:31.824424 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:31.840096 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:31.840044 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-s4pkg" podStartSLOduration=0.993149919 podStartE2EDuration="3.840030126s" totalImagesPullingTime="2.846880207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:41:31.838878907 +0000 UTC m=+774.414571206" watchObservedRunningTime="2026-07-01 16:41:31.840030126 +0000 UTC m=+774.415722415" Jul 01 16:41:32.717371 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:32.717334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:32.772113 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:32.772074 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:37.869090 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:37.869067 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-s4pkg" Jul 01 16:41:38.163166 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:38.163082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:38.299980 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:38.299943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:38.403613 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:38.403580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:41:46.533342 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.533303 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt"] Jul 01 16:41:46.540593 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.540567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" Jul 01 16:41:46.543620 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.543519 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:41:46.543620 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.543563 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:41:46.543620 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.543527 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-h2zpg\"" Jul 01 16:41:46.544166 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.544142 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt"] Jul 01 16:41:46.610599 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.610559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm7zp\" (UniqueName: \"kubernetes.io/projected/594c4cd5-398e-477d-9ef5-f7a47d347d7b-kube-api-access-lm7zp\") pod \"keycloak-operator-d8b9d7b4d-jp7nt\" (UID: \"594c4cd5-398e-477d-9ef5-f7a47d347d7b\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" Jul 01 16:41:46.711885 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.711844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm7zp\" (UniqueName: \"kubernetes.io/projected/594c4cd5-398e-477d-9ef5-f7a47d347d7b-kube-api-access-lm7zp\") pod \"keycloak-operator-d8b9d7b4d-jp7nt\" (UID: \"594c4cd5-398e-477d-9ef5-f7a47d347d7b\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" Jul 01 16:41:46.724014 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.723978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm7zp\" (UniqueName: \"kubernetes.io/projected/594c4cd5-398e-477d-9ef5-f7a47d347d7b-kube-api-access-lm7zp\") pod \"keycloak-operator-d8b9d7b4d-jp7nt\" (UID: \"594c4cd5-398e-477d-9ef5-f7a47d347d7b\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" Jul 01 16:41:46.853137 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.853036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" Jul 01 16:41:46.983843 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:46.983817 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt"] Jul 01 16:41:46.986297 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:41:46.986269 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594c4cd5_398e_477d_9ef5_f7a47d347d7b.slice/crio-fd6072dd8676d62ae47ebc86f7b3c1b7d145255cdf5a431df0b23bc6b1c95b62 WatchSource:0}: Error finding container fd6072dd8676d62ae47ebc86f7b3c1b7d145255cdf5a431df0b23bc6b1c95b62: Status 404 returned error can't find the container with id fd6072dd8676d62ae47ebc86f7b3c1b7d145255cdf5a431df0b23bc6b1c95b62 Jul 01 16:41:47.903776 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:47.903737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" event={"ID":"594c4cd5-398e-477d-9ef5-f7a47d347d7b","Type":"ContainerStarted","Data":"fd6072dd8676d62ae47ebc86f7b3c1b7d145255cdf5a431df0b23bc6b1c95b62"} Jul 01 16:41:53.932745 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:53.932702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" event={"ID":"594c4cd5-398e-477d-9ef5-f7a47d347d7b","Type":"ContainerStarted","Data":"47a5b885ae3381b86690eacbaf84d97caf0ad9d8c660b2d769b190b3abe5a94e"} Jul 01 16:41:53.948749 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:41:53.948701 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-jp7nt" podStartSLOduration=2.0603162839999998 podStartE2EDuration="7.948686595s" totalImagesPullingTime="5.888370311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:41:53.947591302 +0000 UTC m=+796.523283610" watchObservedRunningTime="2026-07-01 16:41:53.948686595 +0000 UTC m=+796.524378885" Jul 01 16:42:01.714864 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:01.714761 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:01.763308 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:01.763256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:31.101379 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:31.101339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:31.449543 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:31.449509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:37.673084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:37.673042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:37.793387 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:37.793350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:37.855656 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:37.855581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:37.964244 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:37.964209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:41.244970 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:41.244939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:42:41.344604 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:42:41.344567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:13.622685 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:13.622647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:14.136104 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.136065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:14.442445 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.442396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:14.559088 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.559054 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:14.657775 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.657740 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:14.678833 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.678799 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-wwdmn"] Jul 01 16:43:14.681235 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.681218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.683841 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.683803 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-w2h5d\"" Jul 01 16:43:14.684185 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.684168 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 16:43:14.693067 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.693006 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-wwdmn"] Jul 01 16:43:14.792507 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.792439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ddb858-b892-4337-b59e-3c7786b26ae5-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-wwdmn\" (UID: \"94ddb858-b892-4337-b59e-3c7786b26ae5\") " pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.792699 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.792529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnfc\" (UniqueName: \"kubernetes.io/projected/94ddb858-b892-4337-b59e-3c7786b26ae5-kube-api-access-7gnfc\") pod \"payload-processing-7bbcb654f4-wwdmn\" (UID: \"94ddb858-b892-4337-b59e-3c7786b26ae5\") " pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.893888 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.893846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnfc\" (UniqueName: \"kubernetes.io/projected/94ddb858-b892-4337-b59e-3c7786b26ae5-kube-api-access-7gnfc\") pod \"payload-processing-7bbcb654f4-wwdmn\" (UID: \"94ddb858-b892-4337-b59e-3c7786b26ae5\") " pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.894079 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.893944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ddb858-b892-4337-b59e-3c7786b26ae5-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-wwdmn\" (UID: \"94ddb858-b892-4337-b59e-3c7786b26ae5\") " pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.894651 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.894632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ddb858-b892-4337-b59e-3c7786b26ae5-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-wwdmn\" (UID: \"94ddb858-b892-4337-b59e-3c7786b26ae5\") " pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.901845 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.901823 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnfc\" (UniqueName: \"kubernetes.io/projected/94ddb858-b892-4337-b59e-3c7786b26ae5-kube-api-access-7gnfc\") pod \"payload-processing-7bbcb654f4-wwdmn\" (UID: \"94ddb858-b892-4337-b59e-3c7786b26ae5\") " pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:14.992640 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:14.992538 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:15.133212 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:15.133188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-wwdmn"] Jul 01 16:43:15.135361 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:43:15.135332 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ddb858_b892_4337_b59e_3c7786b26ae5.slice/crio-facaf42bca52a503f2b8a6600b38a8155e19360828aba46120e6fd495b512dbd WatchSource:0}: Error finding container facaf42bca52a503f2b8a6600b38a8155e19360828aba46120e6fd495b512dbd: Status 404 returned error can't find the container with id facaf42bca52a503f2b8a6600b38a8155e19360828aba46120e6fd495b512dbd Jul 01 16:43:15.137375 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:15.137356 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:43:15.299510 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:15.299387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" event={"ID":"94ddb858-b892-4337-b59e-3c7786b26ae5","Type":"ContainerStarted","Data":"facaf42bca52a503f2b8a6600b38a8155e19360828aba46120e6fd495b512dbd"} Jul 01 16:43:18.316407 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:18.316368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" event={"ID":"94ddb858-b892-4337-b59e-3c7786b26ae5","Type":"ContainerStarted","Data":"815e05f2185a23b4c7c82a8740f1215e653a8712b6a58dd564442a1cd19e36f4"} Jul 01 16:43:18.316858 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:18.316616 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:18.331727 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:18.331677 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" podStartSLOduration=2.064505093 podStartE2EDuration="4.331655587s" totalImagesPullingTime="2.267150494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:43:18.33074594 +0000 UTC m=+880.906438231" watchObservedRunningTime="2026-07-01 16:43:18.331655587 +0000 UTC m=+880.907347877" Jul 01 16:43:29.323671 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:29.323582 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:43:37.851590 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:37.851553 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:43:37.854982 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:37.854959 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:43:37.856041 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:37.856021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:43:37.858656 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:37.858635 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:43:51.131788 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:51.131749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:51.256195 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:51.256155 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:43:51.576138 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:43:51.576104 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:05.126188 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:05.126146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:08.182823 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:08.182784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:15.515340 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:15.515290 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:23.570820 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:23.570786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:30.811906 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:30.811867 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:38.601518 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:38.601462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:38.653280 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:38.653246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:41.187542 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.187504 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22"] Jul 01 16:44:41.191291 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.191268 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.195296 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.195018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 16:44:41.195296 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.195035 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sjkr6\"" Jul 01 16:44:41.195296 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.195050 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 16:44:41.195296 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.195075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 16:44:41.197821 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.197800 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22"] Jul 01 16:44:41.215148 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.215107 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:44:41.330348 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.330303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.330560 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.330360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.330560 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.330399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds2vp\" (UniqueName: \"kubernetes.io/projected/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-kube-api-access-ds2vp\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.330560 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.330528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.330672 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.330588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431203 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431203 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431444 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431444 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds2vp\" (UniqueName: \"kubernetes.io/projected/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-kube-api-access-ds2vp\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431444 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431651 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.431750 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.431728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.433714 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.433694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.433848 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.433832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.439552 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.439534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds2vp\" (UniqueName: \"kubernetes.io/projected/c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b-kube-api-access-ds2vp\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22\" (UID: \"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.502595 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.502552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:41.632367 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.632341 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22"] Jul 01 16:44:41.635134 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:44:41.635106 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b9dfa7_5f8f_4ca4_8e30_5915a1f44c2b.slice/crio-548b8c2ddf157b10558009b26fb127e2bdc7d15fb606c5615852ec6c63e571d3 WatchSource:0}: Error finding container 548b8c2ddf157b10558009b26fb127e2bdc7d15fb606c5615852ec6c63e571d3: Status 404 returned error can't find the container with id 548b8c2ddf157b10558009b26fb127e2bdc7d15fb606c5615852ec6c63e571d3 Jul 01 16:44:41.677521 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:41.677469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" event={"ID":"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b","Type":"ContainerStarted","Data":"548b8c2ddf157b10558009b26fb127e2bdc7d15fb606c5615852ec6c63e571d3"} Jul 01 16:44:43.687853 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:43.687809 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" event={"ID":"c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b","Type":"ContainerStarted","Data":"eeb8bb88e1bc93eb870a186320be6fca0eba85474b47f022a7f3eea2fa3bd04a"} Jul 01 16:44:43.704609 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:43.704557 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" podStartSLOduration=1.6844281030000001 podStartE2EDuration="2.704541286s" totalImagesPullingTime="1.020113183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:44:43.702696837 +0000 UTC m=+966.278389128" watchObservedRunningTime="2026-07-01 16:44:43.704541286 +0000 UTC m=+966.280233575" Jul 01 16:44:51.503392 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:51.503350 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:51.503887 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:51.503465 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:51.517111 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:51.517074 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:44:51.737205 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:44:51.737173 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22" Jul 01 16:45:03.706049 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:45:03.705962 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:10.586026 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:45:10.585975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:10.834282 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:45:10.834244 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:16.928102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:45:16.928065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:45:22.112516 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:45:22.112450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:27.254884 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:27.254831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:27.346265 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:27.346220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:28.316619 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:28.316570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:28.418231 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:28.418194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:46:33.185073 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:33.185038 2562 generic.go:356] "Generic (PLEG): container finished" podID="94ddb858-b892-4337-b59e-3c7786b26ae5" containerID="815e05f2185a23b4c7c82a8740f1215e653a8712b6a58dd564442a1cd19e36f4" exitCode=2 Jul 01 16:46:33.185457 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:33.185116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" event={"ID":"94ddb858-b892-4337-b59e-3c7786b26ae5","Type":"ContainerDied","Data":"815e05f2185a23b4c7c82a8740f1215e653a8712b6a58dd564442a1cd19e36f4"} Jul 01 16:46:33.185540 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:33.185506 2562 scope.go:117] "RemoveContainer" containerID="815e05f2185a23b4c7c82a8740f1215e653a8712b6a58dd564442a1cd19e36f4" Jul 01 16:46:34.191373 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:34.191333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" event={"ID":"94ddb858-b892-4337-b59e-3c7786b26ae5","Type":"ContainerStarted","Data":"640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f"} Jul 01 16:46:34.191844 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:34.191558 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:46:45.198113 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:46:45.198081 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:47:06.334591 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:06.334556 2562 generic.go:356] "Generic (PLEG): container finished" podID="94ddb858-b892-4337-b59e-3c7786b26ae5" containerID="640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f" exitCode=2 Jul 01 16:47:06.335102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:06.334636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" event={"ID":"94ddb858-b892-4337-b59e-3c7786b26ae5","Type":"ContainerDied","Data":"640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f"} Jul 01 16:47:06.335102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:06.334696 2562 scope.go:117] "RemoveContainer" containerID="815e05f2185a23b4c7c82a8740f1215e653a8712b6a58dd564442a1cd19e36f4" Jul 01 16:47:06.335102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:06.335065 2562 scope.go:117] "RemoveContainer" containerID="640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f" Jul 01 16:47:06.335328 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:47:06.335306 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-wwdmn_openshift-ingress(94ddb858-b892-4337-b59e-3c7786b26ae5)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" podUID="94ddb858-b892-4337-b59e-3c7786b26ae5" Jul 01 16:47:10.643965 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:10.643930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9497df747-bhfqx_58727a69-525d-4041-b9c6-8d21ced1b366/nginx/0.log" Jul 01 16:47:11.884642 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:11.884618 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bbcfc888-w2l68_e6c11a44-981c-49a5-b536-e422fc1c6a30/copy-manifests/0.log" Jul 01 16:47:11.902918 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:11.902879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bbcfc888-w2l68_e6c11a44-981c-49a5-b536-e422fc1c6a30/manager/0.log" Jul 01 16:47:12.008455 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:12.008425 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s4pkg_811c015f-caf8-4b87-bead-01069e5a9d69/postgres/0.log" Jul 01 16:47:14.513977 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:14.513943 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6ss8k_c5851aed-ddb6-480c-b881-7fdb6700b729/discovery/0.log" Jul 01 16:47:14.992874 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:14.992834 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:47:14.993202 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:14.993187 2562 scope.go:117] "RemoveContainer" containerID="640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f" Jul 01 16:47:14.993371 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:47:14.993351 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-wwdmn_openshift-ingress(94ddb858-b892-4337-b59e-3c7786b26ae5)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" podUID="94ddb858-b892-4337-b59e-3c7786b26ae5" Jul 01 16:47:15.044727 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:15.044696 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/1.log" Jul 01 16:47:15.155031 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:15.154995 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f84f844d5-d96l8_1aaa5207-ca6c-4a4f-9132-af836d1da051/router/0.log" Jul 01 16:47:15.196427 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:15.196388 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:47:15.376782 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:15.376701 2562 scope.go:117] "RemoveContainer" containerID="640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f" Jul 01 16:47:15.376932 ip-10-0-135-32 kubenswrapper[2562]: E0701 16:47:15.376915 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-wwdmn_openshift-ingress(94ddb858-b892-4337-b59e-3c7786b26ae5)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" podUID="94ddb858-b892-4337-b59e-3c7786b26ae5" Jul 01 16:47:15.703030 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:15.703003 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-scp22_c7b9dfa7-5f8f-4ca4-8e30-5915a1f44c2b/main/0.log" Jul 01 16:47:20.254545 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:20.254506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:20.316260 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:20.316213 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" limit=1024 Jul 01 16:47:23.385828 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:23.385782 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tgx29_6ea1111c-e0ea-45e1-a29b-aaccc6fbc154/global-pull-secret-syncer/0.log" Jul 01 16:47:23.432001 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:23.431970 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4gsxd_c151de77-21a2-46bf-b289-3bed524e8a56/konnectivity-agent/0.log" Jul 01 16:47:23.550355 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:23.550327 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-32.ec2.internal_9780f0e5ad59932d715562fcbe9c29d6/haproxy/0.log" Jul 01 16:47:30.611499 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.611439 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wbswv_66158722-15b9-4014-93ac-aa874e0540b8/node-exporter/0.log" Jul 01 16:47:30.638551 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.638513 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wbswv_66158722-15b9-4014-93ac-aa874e0540b8/kube-rbac-proxy/0.log" Jul 01 16:47:30.663821 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.663786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wbswv_66158722-15b9-4014-93ac-aa874e0540b8/init-textfile/0.log" Jul 01 16:47:30.689829 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.689803 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-dp4ht_56441fd9-bb6c-44b2-9b26-f6e0f6e01c81/kube-rbac-proxy-main/0.log" Jul 01 16:47:30.711950 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.711926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-dp4ht_56441fd9-bb6c-44b2-9b26-f6e0f6e01c81/kube-rbac-proxy-self/0.log" Jul 01 16:47:30.737095 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.737061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-dp4ht_56441fd9-bb6c-44b2-9b26-f6e0f6e01c81/openshift-state-metrics/0.log" Jul 01 16:47:30.772046 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.772020 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/prometheus/0.log" Jul 01 16:47:30.790660 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.790619 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/config-reloader/0.log" Jul 01 16:47:30.811802 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.811777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/thanos-sidecar/0.log" Jul 01 16:47:30.829895 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.829870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/kube-rbac-proxy-web/0.log" Jul 01 16:47:30.848991 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.848968 2562 scope.go:117] "RemoveContainer" containerID="640ea160ea85d91709b5788ecb395d87f497dbe2d237a1a8550f78ee4b45251f" Jul 01 16:47:30.851102 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.851085 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/kube-rbac-proxy/0.log" Jul 01 16:47:30.877835 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.877804 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/kube-rbac-proxy-thanos/0.log" Jul 01 16:47:30.898974 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.898949 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93194267-0b8c-40e1-92a2-5fc2aed0ed6d/init-config-reloader/0.log" Jul 01 16:47:30.931084 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.931057 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-4hwnd_08d11454-820d-41cb-a354-e3459f09826a/prometheus-operator/0.log" Jul 01 16:47:30.950884 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.950797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-4hwnd_08d11454-820d-41cb-a354-e3459f09826a/kube-rbac-proxy/0.log" Jul 01 16:47:30.975443 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:30.975411 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-tn7zh_1bffdbec-f12c-4209-9048-3743ec31b1e3/prometheus-operator-admission-webhook/0.log" Jul 01 16:47:31.461120 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:31.461090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" event={"ID":"94ddb858-b892-4337-b59e-3c7786b26ae5","Type":"ContainerStarted","Data":"344482d97c5d0d287b34532efdd12be0d7c5e7fb33bf4f22e409f25d1a895800"} Jul 01 16:47:31.461337 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:31.461319 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:47:33.073832 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.073797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/1.log" Jul 01 16:47:33.083699 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.083660 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-7d86v_51aa7164-1cb8-4687-94a2-5c1f6c9b73c0/console-operator/2.log" Jul 01 16:47:33.765003 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.764967 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj"] Jul 01 16:47:33.768364 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.768341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.771188 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.771153 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t5k2s\"/\"openshift-service-ca.crt\"" Jul 01 16:47:33.772363 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.772341 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t5k2s\"/\"default-dockercfg-w7424\"" Jul 01 16:47:33.772464 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.772397 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t5k2s\"/\"kube-root-ca.crt\"" Jul 01 16:47:33.774839 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.774820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj"] Jul 01 16:47:33.856093 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.856063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-podres\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.856251 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.856106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-sys\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.856251 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.856136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-proc\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.856251 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.856156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47ck\" (UniqueName: \"kubernetes.io/projected/9e6fcf81-c6a7-42f3-a65c-057cda91c055-kube-api-access-v47ck\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.856251 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.856175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-lib-modules\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.956765 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-podres\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.956944 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-sys\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.956944 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-sys\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.956944 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-proc\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.957061 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47ck\" (UniqueName: \"kubernetes.io/projected/9e6fcf81-c6a7-42f3-a65c-057cda91c055-kube-api-access-v47ck\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.957061 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-lib-modules\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.957061 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.956915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-podres\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.957156 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.957088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-lib-modules\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.957156 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.957135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e6fcf81-c6a7-42f3-a65c-057cda91c055-proc\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:33.964536 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:33.964501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47ck\" (UniqueName: \"kubernetes.io/projected/9e6fcf81-c6a7-42f3-a65c-057cda91c055-kube-api-access-v47ck\") pod \"perf-node-gather-daemonset-d5gzj\" (UID: \"9e6fcf81-c6a7-42f3-a65c-057cda91c055\") " pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:34.079787 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:34.079699 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:34.218427 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:34.214215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj"] Jul 01 16:47:34.219118 ip-10-0-135-32 kubenswrapper[2562]: W0701 16:47:34.219087 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e6fcf81_c6a7_42f3_a65c_057cda91c055.slice/crio-ac5726be53d303294e5e85cea1814430e0f1a101790dced9d4e5e1c0749e7e50 WatchSource:0}: Error finding container ac5726be53d303294e5e85cea1814430e0f1a101790dced9d4e5e1c0749e7e50: Status 404 returned error can't find the container with id ac5726be53d303294e5e85cea1814430e0f1a101790dced9d4e5e1c0749e7e50 Jul 01 16:47:34.475906 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:34.475870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" event={"ID":"9e6fcf81-c6a7-42f3-a65c-057cda91c055","Type":"ContainerStarted","Data":"e402e5a0804b5213aa665f90fa4d618d1d8c4310d4d41a86ac8d5c551e2e452b"} Jul 01 16:47:34.476107 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:34.475928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" event={"ID":"9e6fcf81-c6a7-42f3-a65c-057cda91c055","Type":"ContainerStarted","Data":"ac5726be53d303294e5e85cea1814430e0f1a101790dced9d4e5e1c0749e7e50"} Jul 01 16:47:34.476107 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:34.476012 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:34.491810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:34.491755 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" podStartSLOduration=1.491737527 podStartE2EDuration="1.491737527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:47:34.490299321 +0000 UTC m=+1137.065991611" watchObservedRunningTime="2026-07-01 16:47:34.491737527 +0000 UTC m=+1137.067429817" Jul 01 16:47:35.403810 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:35.403783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-757ql_1cf5670e-8038-4292-99c6-5a1e6f802583/dns/0.log" Jul 01 16:47:35.422609 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:35.422581 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-757ql_1cf5670e-8038-4292-99c6-5a1e6f802583/kube-rbac-proxy/0.log" Jul 01 16:47:35.485636 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:35.485604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8k45g_4809f2d1-90dc-4499-9559-d31551ade25c/dns-node-resolver/0.log" Jul 01 16:47:36.032979 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:36.032952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d42pq_c54ccd70-1122-45ee-bd23-12c3535cfe86/node-ca/0.log" Jul 01 16:47:37.046275 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:37.046240 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6ss8k_c5851aed-ddb6-480c-b881-7fdb6700b729/discovery/0.log" Jul 01 16:47:37.162341 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:37.162309 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/2.log" Jul 01 16:47:37.163547 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:37.163526 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/1.log" Jul 01 16:47:37.183291 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:37.183251 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f84f844d5-d96l8_1aaa5207-ca6c-4a4f-9132-af836d1da051/router/0.log" Jul 01 16:47:37.841683 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:37.841655 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqxxd_e96aa6e7-359b-4778-bbb5-a255b3418abe/serve-healthcheck-canary/0.log" Jul 01 16:47:38.425907 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:38.425876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5mzn_ca677b7e-ba0f-4446-a123-d0bf18b83970/kube-rbac-proxy/0.log" Jul 01 16:47:38.445029 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:38.445002 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5mzn_ca677b7e-ba0f-4446-a123-d0bf18b83970/exporter/0.log" Jul 01 16:47:38.464155 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:38.464124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5mzn_ca677b7e-ba0f-4446-a123-d0bf18b83970/extractor/0.log" Jul 01 16:47:40.490524 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:40.490497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t5k2s/perf-node-gather-daemonset-d5gzj" Jul 01 16:47:40.515683 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:40.515653 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9497df747-bhfqx_58727a69-525d-4041-b9c6-8d21ced1b366/nginx/0.log" Jul 01 16:47:40.894344 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:40.894262 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bbcfc888-w2l68_e6c11a44-981c-49a5-b536-e422fc1c6a30/manager/0.log" Jul 01 16:47:40.910599 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:40.910576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bbcfc888-w2l68_e6c11a44-981c-49a5-b536-e422fc1c6a30/copy-manifests/0.log" Jul 01 16:47:40.933442 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:40.933402 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s4pkg_811c015f-caf8-4b87-bead-01069e5a9d69/postgres/0.log" Jul 01 16:47:42.381225 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:42.381194 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6975944b75-wg56h_5f12f438-58c7-4686-8b94-ea1348873a19/manager/0.log" Jul 01 16:47:42.468107 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:42.468072 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-wwdmn" Jul 01 16:47:44.089224 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:44.089132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6ss8k_c5851aed-ddb6-480c-b881-7fdb6700b729/discovery/0.log" Jul 01 16:47:44.166643 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:44.166608 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/2.log" Jul 01 16:47:44.167934 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:44.167897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/1.log" Jul 01 16:47:44.179336 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:44.179315 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f84f844d5-d96l8_1aaa5207-ca6c-4a4f-9132-af836d1da051/router/0.log" Jul 01 16:47:45.310307 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:45.310270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6ss8k_c5851aed-ddb6-480c-b881-7fdb6700b729/discovery/0.log" Jul 01 16:47:45.404940 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:45.404842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/2.log" Jul 01 16:47:45.405911 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:45.405885 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-wwdmn_94ddb858-b892-4337-b59e-3c7786b26ae5/payload-processing/1.log" Jul 01 16:47:45.437584 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:45.437551 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f84f844d5-d96l8_1aaa5207-ca6c-4a4f-9132-af836d1da051/router/0.log" Jul 01 16:47:49.040362 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.040332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/kube-multus-additional-cni-plugins/0.log" Jul 01 16:47:49.084779 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.084748 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/egress-router-binary-copy/0.log" Jul 01 16:47:49.122121 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.122088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/cni-plugins/0.log" Jul 01 16:47:49.167646 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.167614 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/bond-cni-plugin/0.log" Jul 01 16:47:49.211736 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.211708 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/routeoverride-cni/0.log" Jul 01 16:47:49.236173 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.236147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/whereabouts-cni-bincopy/0.log" Jul 01 16:47:49.256725 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.256693 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cdnk5_22124612-6bae-48e5-ad05-ddc1650ceeac/whereabouts-cni/0.log" Jul 01 16:47:49.653282 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.653245 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hcxk7_182bc735-1743-4a07-9fa7-5289de42e45f/kube-multus/0.log" Jul 01 16:47:49.867262 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.867235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g5vvh_79b89364-2abe-4125-be3a-1a96a0c1379c/network-metrics-daemon/0.log" Jul 01 16:47:49.889830 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:49.889799 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g5vvh_79b89364-2abe-4125-be3a-1a96a0c1379c/kube-rbac-proxy/0.log" Jul 01 16:47:51.027933 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.027900 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-controller/0.log" Jul 01 16:47:51.043664 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.043631 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/0.log" Jul 01 16:47:51.043664 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.043635 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovn-acl-logging/1.log" Jul 01 16:47:51.068149 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.068110 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/kube-rbac-proxy-node/0.log" Jul 01 16:47:51.092958 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.092929 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 16:47:51.107778 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.107747 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/northd/0.log" Jul 01 16:47:51.125765 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.125739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/nbdb/0.log" Jul 01 16:47:51.143541 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.143511 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/sbdb/0.log" Jul 01 16:47:51.205465 ip-10-0-135-32 kubenswrapper[2562]: I0701 16:47:51.205429 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dm4ck_db59440d-ebeb-4a5a-a88c-1a14bdfe0875/ovnkube-controller/0.log"