Jul 16 00:42:06.172588 ip-10-0-142-151 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 00:42:06.172603 ip-10-0-142-151 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 00:42:06.172614 ip-10-0-142-151 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 00:42:06.172929 ip-10-0-142-151 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 00:42:16.196732 ip-10-0-142-151 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 00:42:16.196755 ip-10-0-142-151 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2449a613514344f48acfee28f77b71da -- Jul 16 00:44:11.365270 ip-10-0-142-151 systemd[1]: Starting Kubernetes Kubelet... Jul 16 00:44:11.742858 ip-10-0-142-151 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:44:11.742858 ip-10-0-142-151 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 00:44:11.742858 ip-10-0-142-151 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:44:11.742858 ip-10-0-142-151 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 00:44:11.742858 ip-10-0-142-151 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:44:11.743829 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.743746 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 00:44:11.747534 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747519 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:11.747534 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747533 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747537 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747540 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747543 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747546 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747549 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747552 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747555 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747559 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747561 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747564 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747570 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747572 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747575 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747578 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747580 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747583 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747585 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747588 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747591 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:11.747594 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747593 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747596 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747598 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747601 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747605 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747610 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747612 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747615 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747617 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747620 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747622 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747625 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747627 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747630 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747633 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747635 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747638 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747640 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747642 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747645 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:11.748083 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747647 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747650 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747652 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747655 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747663 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747665 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747667 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747670 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747672 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747674 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747678 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747682 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747685 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747687 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747708 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747713 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747716 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747719 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747722 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747725 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:11.748575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747727 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747730 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747733 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747736 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747739 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747741 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747744 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747747 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747750 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747753 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747755 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747757 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747760 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747766 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747769 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747771 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747774 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747776 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747778 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:11.749087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747781 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747783 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747786 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747788 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747791 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747793 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747797 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747801 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747804 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747806 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747809 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747812 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747814 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747817 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747820 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747824 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747827 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747830 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.747833 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:11.749541 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748522 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748529 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748533 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748535 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748539 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748542 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748544 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748547 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748550 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748553 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748556 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748558 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748561 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748563 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748566 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748568 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748570 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748573 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748575 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:11.750015 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748578 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748582 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748584 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748587 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748590 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748594 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748598 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748601 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748604 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748607 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748609 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748612 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748615 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748618 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748621 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748624 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748626 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748629 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748631 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748634 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:11.750526 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748636 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748638 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748641 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748643 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748646 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748648 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748651 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748654 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748656 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748658 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748661 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748663 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748666 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748669 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748671 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748674 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748676 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748678 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748681 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748683 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:11.751030 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748686 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748689 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748691 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748693 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748696 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748698 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748701 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748703 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748706 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748708 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748710 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748713 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748715 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748718 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748720 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748726 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748730 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748733 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748736 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748739 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:11.751515 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748741 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748744 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748746 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748748 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748752 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748755 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748758 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748762 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748765 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748768 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748770 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748774 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748777 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748779 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748781 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748784 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748787 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748790 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748792 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:11.752009 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.748794 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749208 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749214 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749218 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749221 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749223 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749226 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749228 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749231 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749234 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749236 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749239 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749242 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749245 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749247 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749251 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749255 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749260 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749264 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:11.752472 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749267 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749270 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749273 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749276 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749278 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749281 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749283 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749286 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749289 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749291 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749294 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749296 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749298 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749301 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749303 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749306 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749308 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749311 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749313 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749315 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:11.752932 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749318 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749320 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749323 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749326 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749328 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749330 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749333 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749335 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749338 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749340 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749345 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749349 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749352 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749354 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749357 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749359 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749361 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749364 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749367 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749369 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:11.753440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749372 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749375 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749379 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749381 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749384 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749387 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749390 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749393 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749395 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749398 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749400 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749402 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749405 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749407 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749410 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749412 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749415 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749432 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749435 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749438 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:11.753929 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749441 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749444 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749447 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749451 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749453 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749456 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749461 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749464 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749467 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749470 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749473 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749475 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749478 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749480 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749483 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749485 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749488 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749490 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749492 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:11.754440 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749495 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.749497 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749566 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749575 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749584 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749602 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749608 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749611 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749615 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749620 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749623 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749626 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749629 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749632 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749635 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749638 2567 flags.go:64] FLAG: --cgroup-root="" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749643 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749646 2567 flags.go:64] FLAG: --client-ca-file="" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749649 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749652 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749656 2567 flags.go:64] FLAG: --cluster-domain="" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749658 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749662 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749664 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 00:44:11.754912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749668 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749671 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749674 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749677 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749680 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749683 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749686 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749688 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749692 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749694 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749698 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749701 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749704 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749706 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749709 2567 flags.go:64] FLAG: --enable-server="true" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749712 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749716 2567 flags.go:64] FLAG: --event-burst="100" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749719 2567 flags.go:64] FLAG: --event-qps="50" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749722 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749725 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749727 2567 flags.go:64] FLAG: --eviction-hard="" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749731 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749734 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749737 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749742 2567 flags.go:64] FLAG: --eviction-soft="" Jul 16 00:44:11.755542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749745 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749748 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749750 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749753 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749756 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749759 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749761 2567 flags.go:64] FLAG: --feature-gates="" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749765 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749768 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749770 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749773 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749776 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749779 2567 flags.go:64] FLAG: --help="false" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749782 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-142-151.ec2.internal" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749785 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749787 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749790 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749793 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749796 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749799 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749801 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749804 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749806 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 00:44:11.756166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749809 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749812 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749815 2567 flags.go:64] FLAG: --kube-reserved="" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749818 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749820 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749823 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749826 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749829 2567 flags.go:64] FLAG: --lock-file="" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749833 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749836 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749838 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749843 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749846 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749849 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749851 2567 flags.go:64] FLAG: --logging-format="text" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749854 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749857 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749860 2567 flags.go:64] FLAG: --manifest-url="" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749863 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749867 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749870 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749873 2567 flags.go:64] FLAG: --max-pods="110" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749877 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749880 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749883 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 00:44:11.756763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749885 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749888 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749891 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749894 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749899 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749902 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749905 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749908 2567 flags.go:64] FLAG: --pod-cidr="" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749911 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749916 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749919 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749922 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749925 2567 flags.go:64] FLAG: --port="10250" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749928 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749931 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0505ca87d1b711bf2" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749934 2567 flags.go:64] FLAG: --qos-reserved="" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749938 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749941 2567 flags.go:64] FLAG: --register-node="true" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749943 2567 flags.go:64] FLAG: --register-with-taints="" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749947 2567 flags.go:64] FLAG: --registry-burst="10" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749949 2567 flags.go:64] FLAG: --registry-qps="5" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749952 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749955 2567 flags.go:64] FLAG: --reserved-memory="" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749958 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749961 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 00:44:11.757676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749964 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749967 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749970 2567 flags.go:64] FLAG: --runonce="false" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749972 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749975 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749978 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749980 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.749983 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750000 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750003 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750006 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750008 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750011 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750014 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750017 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750020 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750023 2567 flags.go:64] FLAG: --system-cgroups="" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750026 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750031 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750037 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750040 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750044 2567 flags.go:64] FLAG: --tls-min-version="" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750047 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750050 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750053 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 00:44:11.758458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750056 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750059 2567 flags.go:64] FLAG: --v="2" Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750062 2567 flags.go:64] FLAG: --version="false" Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750066 2567 flags.go:64] FLAG: --vmodule="" Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750069 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.750072 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750191 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750195 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750198 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750201 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750204 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750206 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750209 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750211 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750213 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750216 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750218 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750220 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750223 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750225 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750228 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:11.759292 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750230 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750232 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750235 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750237 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750239 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750243 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750246 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750249 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750251 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750254 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750257 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750259 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750262 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750264 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750267 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750269 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750271 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750274 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750276 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750279 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:11.759818 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750281 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750284 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750286 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750288 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750291 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750293 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750296 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750298 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750300 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750303 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750305 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750308 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750310 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750312 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750315 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750317 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750320 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750323 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750326 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750329 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:11.760433 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750331 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750334 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750336 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750339 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750341 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750344 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750346 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750348 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750351 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750353 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750355 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750359 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750362 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750365 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750368 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750370 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750373 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750378 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750381 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:11.760934 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750384 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750388 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750391 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750395 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750398 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750402 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750406 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750408 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750412 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750417 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750419 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750422 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750425 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750427 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750430 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750433 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750436 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750438 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:11.761445 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750441 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750443 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750445 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750448 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750450 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.750453 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.751018 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.759542 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.759657 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.759677 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.759683 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759745 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759749 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759753 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:11.761889 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759756 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759760 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759763 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759766 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759784 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759787 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759790 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759793 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759796 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759799 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759802 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759804 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759807 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759810 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759813 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759816 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759819 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759822 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759825 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759828 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:11.762270 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759831 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759833 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759836 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759839 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759842 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759845 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759848 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759851 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759853 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759855 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759858 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759861 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759863 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759866 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759879 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759883 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759886 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759889 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759893 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:11.762819 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759896 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759899 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759902 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759904 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759907 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759910 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759912 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759915 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759918 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759920 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759923 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759926 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759928 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759931 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759933 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759937 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759940 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759943 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759947 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:11.763367 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759950 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759952 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759955 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759958 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759960 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759963 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759965 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759968 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759970 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759973 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759975 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759977 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759980 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759982 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.759984 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760001 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760004 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760006 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760015 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:11.763844 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760017 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760020 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760022 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760025 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760027 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760030 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760034 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760038 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760040 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760043 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760045 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760048 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760051 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760054 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760056 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760059 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760061 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760064 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:11.764345 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760066 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.760071 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760193 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760198 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760201 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760204 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760207 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760209 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760212 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760214 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760217 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760219 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760222 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760224 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760232 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:11.764788 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760235 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760237 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760239 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760242 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760245 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760247 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760250 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760252 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760256 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760259 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760262 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760265 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760268 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760270 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760273 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760276 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760278 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760281 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760283 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:11.765184 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760286 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760288 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760290 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760293 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760295 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760298 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760300 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760304 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760307 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760310 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760312 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760317 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760319 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760327 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760330 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760332 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760335 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760337 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760340 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:11.765658 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760342 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760345 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760347 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760350 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760352 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760355 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760357 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760360 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760362 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760365 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760367 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760370 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760372 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760374 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760376 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760379 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760381 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760384 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760386 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:11.766165 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760388 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760391 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760393 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760395 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760398 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760400 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760402 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760404 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760412 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760415 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760417 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760420 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760422 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760424 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760426 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760429 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760431 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760434 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760438 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760441 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:11.766652 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760443 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760446 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760449 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760451 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760454 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760456 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760458 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760461 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:11.760464 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.760468 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.760596 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.762461 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.763647 2567 server.go:1019] "Starting client certificate rotation" Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.763746 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:44:11.767168 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.763777 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:44:11.767528 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.766116 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:44:11.769347 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.769328 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:44:11.781086 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.781066 2567 log.go:25] "Validated CRI v1 runtime API" Jul 16 00:44:11.783735 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.783719 2567 log.go:25] "Validated CRI v1 image API" Jul 16 00:44:11.784517 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.784498 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 00:44:11.787622 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.787596 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7dd426fe-fb64-48db-ad04-0f7404fa8f9e:/dev/nvme0n1p3 cb6f5c09-bd05-4309-a605-9b513a0a54ef:/dev/nvme0n1p4] Jul 16 00:44:11.787676 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.787631 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 00:44:11.791236 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.791221 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:44:11.793630 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.793524 2567 manager.go:216] Machine: {Timestamp:2026-07-16 00:44:11.792253133 +0000 UTC m=+0.315324378 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103788 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2197c15a1b71486a049a1d0f3a6068 SystemUUID:ec2197c1-5a1b-7148-6a04-9a1d0f3a6068 BootID:2449a613-5143-44f4-8acf-ee28f77b71da Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ae:6b:65:a7:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ae:6b:65:a7:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:88:ff:ec:7d:7c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 00:44:11.793630 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.793626 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 00:44:11.793759 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.793748 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 00:44:11.796410 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.796189 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 00:44:11.796548 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.796415 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-151.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 00:44:11.797566 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.797555 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 00:44:11.797598 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.797568 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 00:44:11.797598 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.797576 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:44:11.798223 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.798212 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:44:11.799433 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.799423 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 00:44:11.802334 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802323 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:44:11.802448 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802439 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 00:44:11.802478 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802468 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 16 00:44:11.802508 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802478 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 00:44:11.802508 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802492 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 00:44:11.802508 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802501 2567 kubelet.go:398] "Adding apiserver pod source" Jul 16 00:44:11.802587 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802510 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 00:44:11.802889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802877 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:44:11.802957 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.802897 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:44:11.804895 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.804876 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 00:44:11.807159 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807146 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 00:44:11.807213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807177 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 00:44:11.807366 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807357 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 00:44:11.807420 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807372 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 00:44:11.807420 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807378 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 00:44:11.807420 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807385 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 00:44:11.807420 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807396 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 00:44:11.807420 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807404 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 00:44:11.807843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807835 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 00:44:11.807843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807843 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 00:44:11.807900 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807850 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 00:44:11.807900 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807855 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 00:44:11.807900 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807864 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 00:44:11.807900 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.807871 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 00:44:11.809315 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.809303 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 00:44:11.809315 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.809314 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 00:44:11.812785 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.812755 2567 server.go:1268] "Started kubelet" Jul 16 00:44:11.812879 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.812828 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 00:44:11.812934 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.812902 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 00:44:11.813027 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.813004 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 00:44:11.813729 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.813705 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-151.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 00:44:11.813869 ip-10-0-142-151 systemd[1]: Started Kubernetes Kubelet. Jul 16 00:44:11.813983 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.813968 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 00:44:11.814308 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.814281 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 00:44:11.814308 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.814279 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 00:44:11.815427 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.815412 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 16 00:44:11.818487 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.818469 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 00:44:11.819397 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.818528 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-151.ec2.internal.18c29e7a9ad01046 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-151.ec2.internal,UID:ip-10-0-142-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-151.ec2.internal,},FirstTimestamp:2026-07-16 00:44:11.812663366 +0000 UTC m=+0.335734611,LastTimestamp:2026-07-16 00:44:11.812663366 +0000 UTC m=+0.335734611,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-151.ec2.internal,}" Jul 16 00:44:11.819548 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.819536 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 00:44:11.819969 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.819597 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 00:44:11.819969 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.819629 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:11.820110 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820098 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 00:44:11.820174 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820114 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 00:44:11.820239 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820188 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 00:44:11.820288 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820237 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 16 00:44:11.820288 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820251 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 16 00:44:11.820584 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820569 2567 factory.go:55] Registering systemd factory Jul 16 00:44:11.820649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820605 2567 factory.go:223] Registration of the systemd container factory successfully Jul 16 00:44:11.820845 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820830 2567 factory.go:153] Registering CRI-O factory Jul 16 00:44:11.820845 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820848 2567 factory.go:223] Registration of the crio container factory successfully Jul 16 00:44:11.820944 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820907 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 00:44:11.820944 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820926 2567 factory.go:103] Registering Raw factory Jul 16 00:44:11.820944 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.820936 2567 manager.go:1196] Started watching for new ooms in manager Jul 16 00:44:11.821447 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.821429 2567 manager.go:349] Starting recovery of all containers Jul 16 00:44:11.828545 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.828514 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 00:44:11.832120 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.832093 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 00:44:11.832374 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.832360 2567 manager.go:354] Recovery completed Jul 16 00:44:11.836607 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.836595 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:11.838730 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.838705 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:11.838825 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.838740 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:11.838825 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.838755 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:11.839284 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.839268 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 00:44:11.839284 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.839280 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:11.839463 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.839282 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 00:44:11.839463 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.839309 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:44:11.839972 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.839957 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:11.840089 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.839981 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:11.840089 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.840012 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:11.840517 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.840497 2567 policy_none.go:49] "None policy: Start" Jul 16 00:44:11.840517 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.840516 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 00:44:11.840644 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.840530 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 00:44:11.840644 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.840471 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-151.ec2.internal.18c29e7a9c5dad1d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-151.ec2.internal,UID:ip-10-0-142-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-151.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-151.ec2.internal,},FirstTimestamp:2026-07-16 00:44:11.838721309 +0000 UTC m=+0.361792562,LastTimestamp:2026-07-16 00:44:11.838721309 +0000 UTC m=+0.361792562,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-151.ec2.internal,}" Jul 16 00:44:11.840644 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.840548 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-82xj8" Jul 16 00:44:11.841630 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.841616 2567 policy_none.go:47] "Start" Jul 16 00:44:11.847148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.847129 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-82xj8" Jul 16 00:44:11.848772 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.848703 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-151.ec2.internal.18c29e7a9c5e0fb1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-151.ec2.internal,UID:ip-10-0-142-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-151.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-151.ec2.internal,},FirstTimestamp:2026-07-16 00:44:11.838746545 +0000 UTC m=+0.361817791,LastTimestamp:2026-07-16 00:44:11.838746545 +0000 UTC m=+0.361817791,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-151.ec2.internal,}" Jul 16 00:44:11.881629 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.881608 2567 manager.go:337] "Starting Device Plugin manager" Jul 16 00:44:11.881752 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.881659 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 00:44:11.881752 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.881669 2567 server.go:87] "Starting device plugin registration server" Jul 16 00:44:11.881912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.881900 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 00:44:11.881956 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.881916 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 00:44:11.882027 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.882011 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 00:44:11.882107 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.882085 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 00:44:11.882107 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.882098 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 00:44:11.882879 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.882862 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 00:44:11.882956 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.882913 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:11.964349 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.964312 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 00:44:11.965622 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.965593 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 00:44:11.965708 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.965647 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 00:44:11.965708 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.965676 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 00:44:11.965798 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.965771 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 00:44:11.968234 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.968215 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:11.982207 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.982188 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:11.982934 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.982918 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:11.983024 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.982954 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:11.983024 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.982966 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:11.983024 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.983006 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-151.ec2.internal" Jul 16 00:44:11.990118 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:11.990105 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-151.ec2.internal" Jul 16 00:44:11.990179 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:11.990125 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-151.ec2.internal\": node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.016363 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.016318 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.066835 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.066807 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal"] Jul 16 00:44:12.066931 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.066889 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:12.067833 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.067818 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:12.067913 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.067846 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:12.067913 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.067857 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:12.069203 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.069191 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:12.069370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.069356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.069413 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.069384 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:12.069981 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.069965 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:12.069981 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.069977 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:12.070092 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.070023 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:12.070092 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.070039 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:12.070092 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.070022 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:12.070092 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.070085 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:12.071285 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.071265 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.071374 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.071306 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:12.071937 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.071920 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:12.072027 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.071951 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:12.072027 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.071966 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:12.105658 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.105629 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-151.ec2.internal\" not found" node="ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.109067 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.109051 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-151.ec2.internal\" not found" node="ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.117107 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.117091 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.121820 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.121800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6552f44da1e8da2807f6f7751b4b674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal\" (UID: \"f6552f44da1e8da2807f6f7751b4b674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.121866 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.121827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6552f44da1e8da2807f6f7751b4b674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal\" (UID: \"f6552f44da1e8da2807f6f7751b4b674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.121866 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.121843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9c2d3e118248939805a7aa39f3081f8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-151.ec2.internal\" (UID: \"f9c2d3e118248939805a7aa39f3081f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.217395 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.217363 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.222756 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.222734 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6552f44da1e8da2807f6f7751b4b674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal\" (UID: \"f6552f44da1e8da2807f6f7751b4b674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.222807 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.222700 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6552f44da1e8da2807f6f7751b4b674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal\" (UID: \"f6552f44da1e8da2807f6f7751b4b674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.222843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.222810 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9c2d3e118248939805a7aa39f3081f8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-151.ec2.internal\" (UID: \"f9c2d3e118248939805a7aa39f3081f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.222843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.222830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9c2d3e118248939805a7aa39f3081f8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-151.ec2.internal\" (UID: \"f9c2d3e118248939805a7aa39f3081f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.222901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.222863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6552f44da1e8da2807f6f7751b4b674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal\" (UID: \"f6552f44da1e8da2807f6f7751b4b674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.222901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.222887 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6552f44da1e8da2807f6f7751b4b674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal\" (UID: \"f6552f44da1e8da2807f6f7751b4b674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.318177 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.318101 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.407662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.407628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.411588 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.411568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.419133 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.419118 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.519634 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.519594 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.620097 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.620027 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.720581 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.720548 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-151.ec2.internal\" not found" Jul 16 00:44:12.755454 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.755432 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:12.763367 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.763351 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 00:44:12.763490 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.763475 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:44:12.763524 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.763503 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:44:12.803665 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.803643 2567 apiserver.go:52] "Watching apiserver" Jul 16 00:44:12.820292 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.820270 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 00:44:12.820389 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.820281 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.823220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.823200 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 00:44:12.823506 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.823487 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qzkgc","openshift-image-registry/node-ca-xf84j","openshift-multus/multus-m6d65","openshift-multus/network-metrics-daemon-jrd68","openshift-network-operator/iptables-alerter-x8dvs","openshift-ovn-kubernetes/ovnkube-node-xjs85","kube-system/global-pull-secret-syncer-w59jq","kube-system/konnectivity-agent-sh2n5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz","openshift-dns/node-resolver-wbqs6","openshift-multus/multus-additional-cni-plugins-8zbnr","openshift-network-diagnostics/network-check-target-nx65d"] Jul 16 00:44:12.824697 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.824679 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.825604 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.825589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:12.825685 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.825639 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:12.826662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.826646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:12.826950 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.826935 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nb6dc\"" Jul 16 00:44:12.827033 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.826975 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.827033 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.826975 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.827715 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.827702 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.828611 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.828594 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tmqnz\"" Jul 16 00:44:12.828692 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.828614 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 00:44:12.828739 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.828713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:12.828784 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.828751 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.828784 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.828772 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:12.829152 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.829139 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.829873 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.829855 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-st5bn\"" Jul 16 00:44:12.829959 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.829930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:12.830317 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.830303 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.830399 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.830327 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 00:44:12.830399 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.830360 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.830857 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.830843 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 00:44:12.831423 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.831407 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.832027 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.832010 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.832170 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.832156 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 00:44:12.832240 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.832228 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fflk2\"" Jul 16 00:44:12.832378 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.832363 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.832978 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.832963 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:44:12.833067 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.833056 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:12.833155 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:12.833140 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:12.834072 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.834052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4gvm2\"" Jul 16 00:44:12.834164 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.834157 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 00:44:12.834378 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.834361 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.834449 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.834437 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:12.834506 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.834451 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 00:44:12.834826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.834809 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.835354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.836447 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.836959 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.836960 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.837192 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.837195 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r7tzh\"" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.837668 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.837739 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" Jul 16 00:44:12.838786 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.838508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:12.839227 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.839214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.839490 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.839477 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-277b4\"" Jul 16 00:44:12.839570 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.839556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 00:44:12.839902 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.839886 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal"] Jul 16 00:44:12.839980 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.839970 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.840731 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.840707 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.841751 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.841712 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nbsvb\"" Jul 16 00:44:12.841837 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.841760 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 00:44:12.841837 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.841741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 00:44:12.842569 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.842538 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 00:44:12.842645 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.842632 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g4st4\"" Jul 16 00:44:12.843146 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.843130 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 00:44:12.846463 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.846450 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal"] Jul 16 00:44:12.846598 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.846585 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:44:12.849562 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.849528 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 00:39:11 +0000 UTC" deadline="2027-12-17 17:19:34.659605649 +0000 UTC" Jul 16 00:44:12.849562 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.849559 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12472h35m21.810048967s" Jul 16 00:44:12.857245 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.857229 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5dngc" Jul 16 00:44:12.862849 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.862831 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:12.866015 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.865969 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5dngc" Jul 16 00:44:12.921215 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.921196 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 00:44:12.926370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926232 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbdbz\" (UniqueName: \"kubernetes.io/projected/dbd11bec-57fe-4279-ac17-c46468899f03-kube-api-access-bbdbz\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:12.926468 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysconfig\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.926468 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tl7c\" (UniqueName: \"kubernetes.io/projected/0ea3320f-3b86-487c-b5ac-96eba061f74e-kube-api-access-2tl7c\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.926468 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926468 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926468 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-env-overrides\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnb7\" (UniqueName: \"kubernetes.io/projected/a0897951-8421-4b59-b896-3577e922488b-kube-api-access-rtnb7\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:12.926662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-sys\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.926662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-systemd-units\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-os-release\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.926662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-host\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:12.926662 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-var-lib-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-etc-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovnkube-config\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926727 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-os-release\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87205380-79f6-44af-ba23-e92130de91c3-cni-binary-copy\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-hostroot\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp28m\" (UniqueName: \"kubernetes.io/projected/58057755-9524-460e-975f-3e1aa107842f-kube-api-access-vp28m\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0897951-8421-4b59-b896-3577e922488b-iptables-alerter-script\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysctl-d\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-lib-modules\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-cni-bin\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-cni-multus\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-systemd\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.926901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-registration-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-serviceca\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.926963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-multus-certs\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-modprobe-d\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-run-netns\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f149c855-2cbf-4457-8785-3f1da93eeeac-dbus\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-etc-selinux\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-etc-kubernetes\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-kubernetes\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-host\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927155 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd7qw\" (UniqueName: \"kubernetes.io/projected/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-kube-api-access-nd7qw\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-cni-bin\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea3320f-3b86-487c-b5ac-96eba061f74e-tmp\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-slash\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-system-cni-dir\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.927636 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927292 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-cnibin\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-netns\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbd11bec-57fe-4279-ac17-c46468899f03-hosts-file\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927384 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgxlv\" (UniqueName: \"kubernetes.io/projected/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-kube-api-access-qgxlv\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e5f646-a91c-40ac-a498-bcbcb5951df8-agent-certs\") pod \"konnectivity-agent-sh2n5\" (UID: \"27e5f646-a91c-40ac-a498-bcbcb5951df8\") " pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdw55\" (UniqueName: \"kubernetes.io/projected/1126c224-f332-4834-816a-5d8b196bb0dd-kube-api-access-bdw55\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-socket-dir-parent\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-conf-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-systemd\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovn-node-metrics-cert\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-system-cni-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f149c855-2cbf-4457-8785-3f1da93eeeac-kubelet-config\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlmsz\" (UniqueName: \"kubernetes.io/projected/cd0a2e5a-f866-41be-b9e6-63c252918ef6-kube-api-access-xlmsz\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-kubelet\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-cnibin\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4rj\" (UniqueName: \"kubernetes.io/projected/87205380-79f6-44af-ba23-e92130de91c3-kube-api-access-4b4rj\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927704 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbd11bec-57fe-4279-ac17-c46468899f03-tmp-dir\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-var-lib-kubelet\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-node-log\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovnkube-script-lib\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-k8s-cni-cncf-io\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-cni-netd\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e5f646-a91c-40ac-a498-bcbcb5951df8-konnectivity-ca\") pod \"konnectivity-agent-sh2n5\" (UID: \"27e5f646-a91c-40ac-a498-bcbcb5951df8\") " pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-cni-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0897951-8421-4b59-b896-3577e922488b-host-slash\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysctl-conf\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-run\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-tuned\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:12.928974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-kubelet\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-device-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.927969 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.928014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87205380-79f6-44af-ba23-e92130de91c3-multus-daemon-config\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.928046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-ovn\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.928068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-log-socket\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.928089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-socket-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.929549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.928113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-sys-fs\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:12.941199 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:12.941171 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c2d3e118248939805a7aa39f3081f8.slice/crio-890a22769876e3396609dca8f4ae151247a06a2a1f1c501bd4c747dab847cf98 WatchSource:0}: Error finding container 890a22769876e3396609dca8f4ae151247a06a2a1f1c501bd4c747dab847cf98: Status 404 returned error can't find the container with id 890a22769876e3396609dca8f4ae151247a06a2a1f1c501bd4c747dab847cf98 Jul 16 00:44:12.941799 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:12.941783 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6552f44da1e8da2807f6f7751b4b674.slice/crio-2efc433d69d669e094fb2e8a81ab721ed272b29ca3ef608eb2a1ceae36a6325c WatchSource:0}: Error finding container 2efc433d69d669e094fb2e8a81ab721ed272b29ca3ef608eb2a1ceae36a6325c: Status 404 returned error can't find the container with id 2efc433d69d669e094fb2e8a81ab721ed272b29ca3ef608eb2a1ceae36a6325c Jul 16 00:44:12.946843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.946825 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:44:12.946980 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.946963 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:12.969498 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.969462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" event={"ID":"f6552f44da1e8da2807f6f7751b4b674","Type":"ContainerStarted","Data":"2efc433d69d669e094fb2e8a81ab721ed272b29ca3ef608eb2a1ceae36a6325c"} Jul 16 00:44:12.970463 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:12.970443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" event={"ID":"f9c2d3e118248939805a7aa39f3081f8","Type":"ContainerStarted","Data":"890a22769876e3396609dca8f4ae151247a06a2a1f1c501bd4c747dab847cf98"} Jul 16 00:44:13.029165 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f149c855-2cbf-4457-8785-3f1da93eeeac-dbus\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:13.029165 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-etc-selinux\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-etc-kubernetes\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-kubernetes\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-host\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd7qw\" (UniqueName: \"kubernetes.io/projected/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-kube-api-access-nd7qw\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-cni-bin\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029258 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-etc-kubernetes\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029274 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f149c855-2cbf-4457-8785-3f1da93eeeac-dbus\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029292 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-kubernetes\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029307 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-etc-selinux\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea3320f-3b86-487c-b5ac-96eba061f74e-tmp\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029312 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-host\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.029344 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-cni-bin\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-slash\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-system-cni-dir\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-cnibin\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029453 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029462 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-slash\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-netns\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029502 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-netns\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029482 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-system-cni-dir\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbd11bec-57fe-4279-ac17-c46468899f03-hosts-file\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029528 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-cnibin\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgxlv\" (UniqueName: \"kubernetes.io/projected/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-kube-api-access-qgxlv\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029566 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dbd11bec-57fe-4279-ac17-c46468899f03-hosts-file\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e5f646-a91c-40ac-a498-bcbcb5951df8-agent-certs\") pod \"konnectivity-agent-sh2n5\" (UID: \"27e5f646-a91c-40ac-a498-bcbcb5951df8\") " pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdw55\" (UniqueName: \"kubernetes.io/projected/1126c224-f332-4834-816a-5d8b196bb0dd-kube-api-access-bdw55\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029588 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-socket-dir-parent\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.029846 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-conf-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-systemd\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovn-node-metrics-cert\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-system-cni-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f149c855-2cbf-4457-8785-3f1da93eeeac-kubelet-config\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029860 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029900 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-socket-dir-parent\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmsz\" (UniqueName: \"kubernetes.io/projected/cd0a2e5a-f866-41be-b9e6-63c252918ef6-kube-api-access-xlmsz\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029948 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-conf-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-kubelet\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.029977 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-cnibin\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.030015 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030022 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-kubelet\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4rj\" (UniqueName: \"kubernetes.io/projected/87205380-79f6-44af-ba23-e92130de91c3-kube-api-access-4b4rj\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.030086 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:13.530063235 +0000 UTC m=+2.053134472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:13.030826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030098 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f149c855-2cbf-4457-8785-3f1da93eeeac-kubelet-config\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030101 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-systemd\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbd11bec-57fe-4279-ac17-c46468899f03-tmp-dir\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030134 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-cnibin\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030157 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-system-cni-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-var-lib-kubelet\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030188 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-var-lib-kubelet\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-node-log\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovnkube-script-lib\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030221 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-node-log\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-k8s-cni-cncf-io\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-cni-netd\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e5f646-a91c-40ac-a498-bcbcb5951df8-konnectivity-ca\") pod \"konnectivity-agent-sh2n5\" (UID: \"27e5f646-a91c-40ac-a498-bcbcb5951df8\") " pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-cni-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0897951-8421-4b59-b896-3577e922488b-host-slash\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysctl-conf\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030472 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-run\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.031567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030530 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbd11bec-57fe-4279-ac17-c46468899f03-tmp-dir\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-tuned\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-kubelet\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-device-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030649 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-k8s-cni-cncf-io\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87205380-79f6-44af-ba23-e92130de91c3-multus-daemon-config\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030702 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-run-ovn-kubernetes\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-ovn\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030739 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-ovn\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-log-socket\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030762 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovnkube-script-lib\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-socket-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030795 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-multus-cni-dir\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-sys-fs\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030818 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-cni-netd\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbdbz\" (UniqueName: \"kubernetes.io/projected/dbd11bec-57fe-4279-ac17-c46468899f03-kube-api-access-bbdbz\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.032387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030834 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0897951-8421-4b59-b896-3577e922488b-host-slash\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030859 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-kubelet\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030885 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-device-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.030617 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.030972 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysctl-conf\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031047 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-run\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.031070 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:44:13.531041748 +0000 UTC m=+2.054112998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-log-socket\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031118 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27e5f646-a91c-40ac-a498-bcbcb5951df8-konnectivity-ca\") pod \"konnectivity-agent-sh2n5\" (UID: \"27e5f646-a91c-40ac-a498-bcbcb5951df8\") " pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031188 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-socket-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031190 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-sys-fs\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysconfig\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tl7c\" (UniqueName: \"kubernetes.io/projected/0ea3320f-3b86-487c-b5ac-96eba061f74e-kube-api-access-2tl7c\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031303 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031317 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysconfig\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-env-overrides\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033148 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031359 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-run-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnb7\" (UniqueName: \"kubernetes.io/projected/a0897951-8421-4b59-b896-3577e922488b-kube-api-access-rtnb7\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-sys\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031395 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-systemd-units\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031458 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-os-release\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-host\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031537 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87205380-79f6-44af-ba23-e92130de91c3-multus-daemon-config\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-var-lib-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031572 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-var-lib-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-etc-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031627 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-sys\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031636 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-etc-openvswitch\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031652 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-os-release\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031660 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-host\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovnkube-config\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031673 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-systemd-units\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.033720 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-os-release\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87205380-79f6-44af-ba23-e92130de91c3-cni-binary-copy\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-hostroot\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp28m\" (UniqueName: \"kubernetes.io/projected/58057755-9524-460e-975f-3e1aa107842f-kube-api-access-vp28m\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0897951-8421-4b59-b896-3577e922488b-iptables-alerter-script\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysctl-d\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-lib-modules\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031901 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-env-overrides\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-cni-bin\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.031980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-cni-multus\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-systemd\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032023 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-hostroot\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-registration-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-serviceca\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.034220 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-multus-certs\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032249 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-var-lib-cni-multus\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-modprobe-d\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-run-netns\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032311 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-systemd\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovnkube-config\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032404 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-cni-bin\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032873 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.032967 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-os-release\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033000 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-sysctl-d\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033051 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-host-run-netns\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033059 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-lib-modules\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033093 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87205380-79f6-44af-ba23-e92130de91c3-host-run-multus-certs\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033183 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033228 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0897951-8421-4b59-b896-3577e922488b-iptables-alerter-script\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd0a2e5a-f866-41be-b9e6-63c252918ef6-registration-dir\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033300 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-modprobe-d\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.034649 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033337 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-ovn-node-metrics-cert\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033400 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1126c224-f332-4834-816a-5d8b196bb0dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033438 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27e5f646-a91c-40ac-a498-bcbcb5951df8-agent-certs\") pod \"konnectivity-agent-sh2n5\" (UID: \"27e5f646-a91c-40ac-a498-bcbcb5951df8\") " pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1126c224-f332-4834-816a-5d8b196bb0dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033548 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87205380-79f6-44af-ba23-e92130de91c3-cni-binary-copy\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033597 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea3320f-3b86-487c-b5ac-96eba061f74e-tmp\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033607 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-serviceca\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.035140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.033908 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ea3320f-3b86-487c-b5ac-96eba061f74e-etc-tuned\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.036479 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.036466 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:13.036518 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.036483 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:13.036518 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.036492 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:13.036574 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.036535 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:44:13.536523224 +0000 UTC m=+2.059594456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:13.038373 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.038346 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgxlv\" (UniqueName: \"kubernetes.io/projected/a6c3e6b4-3841-4609-b6f5-4dee9796eeb7-kube-api-access-qgxlv\") pod \"ovnkube-node-xjs85\" (UID: \"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.039126 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.039104 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd7qw\" (UniqueName: \"kubernetes.io/projected/bb06ec6e-d6ec-476e-840a-ffe9f0f709b9-kube-api-access-nd7qw\") pod \"node-ca-xf84j\" (UID: \"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9\") " pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.039232 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.039175 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdw55\" (UniqueName: \"kubernetes.io/projected/1126c224-f332-4834-816a-5d8b196bb0dd-kube-api-access-bdw55\") pod \"multus-additional-cni-plugins-8zbnr\" (UID: \"1126c224-f332-4834-816a-5d8b196bb0dd\") " pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.040257 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.040233 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b4rj\" (UniqueName: \"kubernetes.io/projected/87205380-79f6-44af-ba23-e92130de91c3-kube-api-access-4b4rj\") pod \"multus-m6d65\" (UID: \"87205380-79f6-44af-ba23-e92130de91c3\") " pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.040361 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.040335 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnb7\" (UniqueName: \"kubernetes.io/projected/a0897951-8421-4b59-b896-3577e922488b-kube-api-access-rtnb7\") pod \"iptables-alerter-x8dvs\" (UID: \"a0897951-8421-4b59-b896-3577e922488b\") " pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.040488 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.040471 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tl7c\" (UniqueName: \"kubernetes.io/projected/0ea3320f-3b86-487c-b5ac-96eba061f74e-kube-api-access-2tl7c\") pod \"tuned-qzkgc\" (UID: \"0ea3320f-3b86-487c-b5ac-96eba061f74e\") " pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.040669 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.040653 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlmsz\" (UniqueName: \"kubernetes.io/projected/cd0a2e5a-f866-41be-b9e6-63c252918ef6-kube-api-access-xlmsz\") pod \"aws-ebs-csi-driver-node-cn6mz\" (UID: \"cd0a2e5a-f866-41be-b9e6-63c252918ef6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.040704 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.040665 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbdbz\" (UniqueName: \"kubernetes.io/projected/dbd11bec-57fe-4279-ac17-c46468899f03-kube-api-access-bbdbz\") pod \"node-resolver-wbqs6\" (UID: \"dbd11bec-57fe-4279-ac17-c46468899f03\") " pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.040959 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.040940 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp28m\" (UniqueName: \"kubernetes.io/projected/58057755-9524-460e-975f-3e1aa107842f-kube-api-access-vp28m\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:13.159863 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.159750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" Jul 16 00:44:13.167634 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.167612 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea3320f_3b86_487c_b5ac_96eba061f74e.slice/crio-8b39200f607fdfe798d50f98f944b0a7550262d4764e83006e20b155ab72dcb0 WatchSource:0}: Error finding container 8b39200f607fdfe798d50f98f944b0a7550262d4764e83006e20b155ab72dcb0: Status 404 returned error can't find the container with id 8b39200f607fdfe798d50f98f944b0a7550262d4764e83006e20b155ab72dcb0 Jul 16 00:44:13.175495 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.175480 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xf84j" Jul 16 00:44:13.182288 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.182266 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb06ec6e_d6ec_476e_840a_ffe9f0f709b9.slice/crio-ae3c305a823661280aba12443e52fdb0bcbe453a1552584f1ecce6ddb92f157a WatchSource:0}: Error finding container ae3c305a823661280aba12443e52fdb0bcbe453a1552584f1ecce6ddb92f157a: Status 404 returned error can't find the container with id ae3c305a823661280aba12443e52fdb0bcbe453a1552584f1ecce6ddb92f157a Jul 16 00:44:13.191263 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.191248 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6d65" Jul 16 00:44:13.200020 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.199964 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87205380_79f6_44af_ba23_e92130de91c3.slice/crio-fa5789e432f6811abdee7f86cd99a5cfb86d9f6b18f96f92daf3bdf0f371125e WatchSource:0}: Error finding container fa5789e432f6811abdee7f86cd99a5cfb86d9f6b18f96f92daf3bdf0f371125e: Status 404 returned error can't find the container with id fa5789e432f6811abdee7f86cd99a5cfb86d9f6b18f96f92daf3bdf0f371125e Jul 16 00:44:13.204962 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.204947 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x8dvs" Jul 16 00:44:13.210114 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.210095 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:13.210809 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.210790 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0897951_8421_4b59_b896_3577e922488b.slice/crio-21d886ef03dbf7ee233590e9558b0f8809ac7528f72dbe5a3708dba951667388 WatchSource:0}: Error finding container 21d886ef03dbf7ee233590e9558b0f8809ac7528f72dbe5a3708dba951667388: Status 404 returned error can't find the container with id 21d886ef03dbf7ee233590e9558b0f8809ac7528f72dbe5a3708dba951667388 Jul 16 00:44:13.214664 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.214641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:13.216459 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.216443 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c3e6b4_3841_4609_b6f5_4dee9796eeb7.slice/crio-988b0be34f1f922136f7308b838b92b737dd64293119795b5d2ea6e4a3aae659 WatchSource:0}: Error finding container 988b0be34f1f922136f7308b838b92b737dd64293119795b5d2ea6e4a3aae659: Status 404 returned error can't find the container with id 988b0be34f1f922136f7308b838b92b737dd64293119795b5d2ea6e4a3aae659 Jul 16 00:44:13.221127 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.221108 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e5f646_a91c_40ac_a498_bcbcb5951df8.slice/crio-defeda300bce188daf6df6ca7c82280c6a58fd9b2e64c0661372ef44985e56d6 WatchSource:0}: Error finding container defeda300bce188daf6df6ca7c82280c6a58fd9b2e64c0661372ef44985e56d6: Status 404 returned error can't find the container with id defeda300bce188daf6df6ca7c82280c6a58fd9b2e64c0661372ef44985e56d6 Jul 16 00:44:13.249298 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.249278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" Jul 16 00:44:13.254561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.254541 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbqs6" Jul 16 00:44:13.256580 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.256558 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0a2e5a_f866_41be_b9e6_63c252918ef6.slice/crio-a7ee4b94896af7e1be81b740cf6d6ef31204a5c7b3239e2e44ec618c57ae9731 WatchSource:0}: Error finding container a7ee4b94896af7e1be81b740cf6d6ef31204a5c7b3239e2e44ec618c57ae9731: Status 404 returned error can't find the container with id a7ee4b94896af7e1be81b740cf6d6ef31204a5c7b3239e2e44ec618c57ae9731 Jul 16 00:44:13.258748 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.258713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" Jul 16 00:44:13.261451 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.261432 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd11bec_57fe_4279_ac17_c46468899f03.slice/crio-c7f88b9d66652cf053d15abdc273a58f81de9678756b7368a4e9627cd653e105 WatchSource:0}: Error finding container c7f88b9d66652cf053d15abdc273a58f81de9678756b7368a4e9627cd653e105: Status 404 returned error can't find the container with id c7f88b9d66652cf053d15abdc273a58f81de9678756b7368a4e9627cd653e105 Jul 16 00:44:13.266064 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:13.266045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1126c224_f332_4834_816a_5d8b196bb0dd.slice/crio-c86dcb9ad39a609ae0397f7d5beea7d55f4c898c662bcd9e6bb302416159fb9a WatchSource:0}: Error finding container c86dcb9ad39a609ae0397f7d5beea7d55f4c898c662bcd9e6bb302416159fb9a: Status 404 returned error can't find the container with id c86dcb9ad39a609ae0397f7d5beea7d55f4c898c662bcd9e6bb302416159fb9a Jul 16 00:44:13.536816 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.536742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:13.536816 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.536786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.536820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.536891 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.536899 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.536908 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.536919 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.536957 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:44:14.536932728 +0000 UTC m=+3.060003960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.537017 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:44:14.53696439 +0000 UTC m=+3.060035627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.537017 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:13.537054 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.537051 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:14.537041907 +0000 UTC m=+3.060113139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:13.594789 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.594753 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:13.868749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.868290 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:39:12 +0000 UTC" deadline="2028-01-17 06:43:21.844682417 +0000 UTC" Jul 16 00:44:13.868749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.868351 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13205h59m7.976335929s" Jul 16 00:44:13.968363 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:13.968334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:13.968547 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:13.968469 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:14.000425 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.000384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerStarted","Data":"c86dcb9ad39a609ae0397f7d5beea7d55f4c898c662bcd9e6bb302416159fb9a"} Jul 16 00:44:14.015263 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.015223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbqs6" event={"ID":"dbd11bec-57fe-4279-ac17-c46468899f03","Type":"ContainerStarted","Data":"c7f88b9d66652cf053d15abdc273a58f81de9678756b7368a4e9627cd653e105"} Jul 16 00:44:14.027524 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.027486 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sh2n5" event={"ID":"27e5f646-a91c-40ac-a498-bcbcb5951df8","Type":"ContainerStarted","Data":"defeda300bce188daf6df6ca7c82280c6a58fd9b2e64c0661372ef44985e56d6"} Jul 16 00:44:14.046608 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.046572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"988b0be34f1f922136f7308b838b92b737dd64293119795b5d2ea6e4a3aae659"} Jul 16 00:44:14.067362 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.067315 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x8dvs" event={"ID":"a0897951-8421-4b59-b896-3577e922488b","Type":"ContainerStarted","Data":"21d886ef03dbf7ee233590e9558b0f8809ac7528f72dbe5a3708dba951667388"} Jul 16 00:44:14.087702 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.087622 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6d65" event={"ID":"87205380-79f6-44af-ba23-e92130de91c3","Type":"ContainerStarted","Data":"fa5789e432f6811abdee7f86cd99a5cfb86d9f6b18f96f92daf3bdf0f371125e"} Jul 16 00:44:14.090070 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.090040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" event={"ID":"cd0a2e5a-f866-41be-b9e6-63c252918ef6","Type":"ContainerStarted","Data":"a7ee4b94896af7e1be81b740cf6d6ef31204a5c7b3239e2e44ec618c57ae9731"} Jul 16 00:44:14.092640 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.092613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xf84j" event={"ID":"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9","Type":"ContainerStarted","Data":"ae3c305a823661280aba12443e52fdb0bcbe453a1552584f1ecce6ddb92f157a"} Jul 16 00:44:14.110290 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.110251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" event={"ID":"0ea3320f-3b86-487c-b5ac-96eba061f74e","Type":"ContainerStarted","Data":"8b39200f607fdfe798d50f98f944b0a7550262d4764e83006e20b155ab72dcb0"} Jul 16 00:44:14.494286 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.494247 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:14.545694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.545584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:14.545694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.545685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:14.545936 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.545725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:14.545936 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.545874 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:14.546076 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.545945 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:44:16.545915212 +0000 UTC m=+5.068986457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:14.546432 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.546379 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:14.546432 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.546402 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:14.546432 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.546415 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:14.546648 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.546460 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:44:16.546445177 +0000 UTC m=+5.069516416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:14.546648 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.546524 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:14.546648 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.546557 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:16.546546069 +0000 UTC m=+5.069617307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:14.869886 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.869488 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:39:12 +0000 UTC" deadline="2028-03-11 03:20:57.213182463 +0000 UTC" Jul 16 00:44:14.869886 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.869526 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14498h36m42.343661005s" Jul 16 00:44:14.966776 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.966738 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:14.967046 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.966875 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:14.967266 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:14.967246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:14.967376 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:14.967356 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:15.966959 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:15.966924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:15.967418 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:15.967086 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:16.564312 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:16.564257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:16.564542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:16.564330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:16.564542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:16.564357 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:16.564542 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.564473 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:16.564542 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.564534 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:20.564516016 +0000 UTC m=+9.087587255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:16.564933 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.564913 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:16.565074 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.564965 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:44:20.564949141 +0000 UTC m=+9.088020375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:16.565074 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.565061 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:16.565074 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.565076 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:16.565290 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.565088 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:16.565290 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.565123 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:44:20.565111324 +0000 UTC m=+9.088182564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:16.966801 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:16.966721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:16.966961 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.966860 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:16.966961 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:16.966905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:16.966961 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:16.967032 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:17.966375 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:17.966321 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:17.966570 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:17.966482 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:18.966277 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:18.966243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:18.966712 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:18.966388 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:18.966712 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:18.966444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:18.966712 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:18.966559 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:19.967266 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:19.966727 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:19.967266 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:19.966883 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:20.595276 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:20.595200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:20.595461 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:20.595293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:20.595461 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:20.595331 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:20.595461 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595421 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:20.595461 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595446 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:20.595461 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595447 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:20.595461 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595459 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:20.595774 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595508 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.5954884 +0000 UTC m=+17.118559654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:20.595774 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595525 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.595515561 +0000 UTC m=+17.118586799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:20.595774 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595556 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:20.595774 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.595596 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.595580237 +0000 UTC m=+17.118651471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:20.966669 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:20.966574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:20.966831 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.966704 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:20.967125 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:20.967097 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:20.967257 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:20.967212 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:21.968749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:21.968714 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:21.969221 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:21.968851 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:22.966652 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:22.966571 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:22.966652 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:22.966613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:22.966969 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:22.966693 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:22.966969 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:22.966800 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:23.966666 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:23.966630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:23.967124 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:23.966763 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:24.966783 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:24.966753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:24.966783 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:24.966797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:24.967299 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:24.966899 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:24.967299 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:24.967046 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:25.966241 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:25.966209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:25.966434 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:25.966354 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:26.966161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:26.966126 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:26.966161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:26.966165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:26.966673 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:26.966256 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:26.966673 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:26.966383 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:27.966238 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:27.966202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:27.966694 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:27.966363 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:28.651032 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:28.650979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:28.651047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:28.651085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651160 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651172 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651182 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651192 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651206 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651234 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:44.651214479 +0000 UTC m=+33.174285735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:28.651249 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651251 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:44:44.651242416 +0000 UTC m=+33.174313650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:28.651701 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.651269 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:44:44.651260685 +0000 UTC m=+33.174331928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:28.966277 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:28.966202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:28.966277 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:28.966225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:28.966747 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.966293 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:28.966747 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:28.966441 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:29.966188 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:29.966153 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:29.966369 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:29.966289 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:30.966577 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:30.966542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:30.967082 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:30.966542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:30.967082 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:30.966712 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:30.967082 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:30.966748 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:31.966701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:31.966662 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:31.967153 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:31.966774 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:32.966566 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:32.966535 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:32.966758 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:32.966659 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:32.966758 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:32.966723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:32.967200 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:32.966838 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:33.966834 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:33.966797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:33.967382 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:33.967024 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:34.152061 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.151968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" event={"ID":"0ea3320f-3b86-487c-b5ac-96eba061f74e","Type":"ContainerStarted","Data":"63da7351c5c7b5e066e1cfe79276b32094ce426454eedf343da93c3aab2beee5"} Jul 16 00:44:34.153621 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.153595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" event={"ID":"f9c2d3e118248939805a7aa39f3081f8","Type":"ContainerStarted","Data":"d107b9f8e77f2f01937c9d59883c50f5091d2e60f6ed6f44aa6313c686d845d7"} Jul 16 00:44:34.154910 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.154889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6d65" event={"ID":"87205380-79f6-44af-ba23-e92130de91c3","Type":"ContainerStarted","Data":"b2172f7763ddf992c2e866997a9ebe8335fa89f21ce4e62a5aa69256952c9416"} Jul 16 00:44:34.170204 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.170166 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qzkgc" podStartSLOduration=2.807749787 podStartE2EDuration="23.170153547s" totalImagesPullingTime="20.36240376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:34.169839904 +0000 UTC m=+22.692911159" watchObservedRunningTime="2026-07-16 00:44:34.170153547 +0000 UTC m=+22.693224841" Jul 16 00:44:34.185654 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.185608 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-151.ec2.internal" podStartSLOduration=22.185596421 podStartE2EDuration="22.185596421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:34.185071173 +0000 UTC m=+22.708142451" watchObservedRunningTime="2026-07-16 00:44:34.185596421 +0000 UTC m=+22.708667676" Jul 16 00:44:34.216118 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.216067 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m6d65" podStartSLOduration=1.886320353 podStartE2EDuration="22.216050503s" totalImagesPullingTime="20.32973015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:34.215794609 +0000 UTC m=+22.738865864" watchObservedRunningTime="2026-07-16 00:44:34.216050503 +0000 UTC m=+22.739121758" Jul 16 00:44:34.966685 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.966414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:34.966886 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:34.966414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:34.966886 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:34.966814 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:34.966886 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:34.966868 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:35.158740 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.158703 2567 generic.go:356] "Generic (PLEG): container finished" podID="1126c224-f332-4834-816a-5d8b196bb0dd" containerID="d60a1be7147eb95da159344cad9ec2734c7c5b5ae3b61da320208963b00b1049" exitCode=0 Jul 16 00:44:35.158871 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.158804 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerDied","Data":"d60a1be7147eb95da159344cad9ec2734c7c5b5ae3b61da320208963b00b1049"} Jul 16 00:44:35.160641 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.160613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbqs6" event={"ID":"dbd11bec-57fe-4279-ac17-c46468899f03","Type":"ContainerStarted","Data":"c5a7575cf84f9694c22fc3fedcb996a2e179e24b106194811968c5a621608f89"} Jul 16 00:44:35.162840 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.162815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sh2n5" event={"ID":"27e5f646-a91c-40ac-a498-bcbcb5951df8","Type":"ContainerStarted","Data":"96df2df3135f5f2ec6e11a2f608f5dd331e07416b1964b64a606630d261209d6"} Jul 16 00:44:35.166069 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166049 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:44:35.166482 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166458 2567 generic.go:356] "Generic (PLEG): container finished" podID="a6c3e6b4-3841-4609-b6f5-4dee9796eeb7" containerID="a8c7b4f270da0e52ba153ffa47b83306c473b6471b52eb3b0a35fc95d5a5109b" exitCode=1 Jul 16 00:44:35.166564 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166484 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"2ae3fd1bb90d5483bc9673f3370eaa59d416633d0cec4cfe29ed98dcdb758dbe"} Jul 16 00:44:35.166564 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"bfa6e1d53401566376fdeebce7afa59351d226ebb2179fc155800c7ea9d0e2e4"} Jul 16 00:44:35.166669 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"3e6a4922e97b24c9872f05abf4ceca26841155b0d174bb580454a31e39e0be4d"} Jul 16 00:44:35.166669 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166640 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"f54a17ad7e6c759269e6ee1dbfa364ac6ccdf0e18a293b32fbf96f9e40b5d1e4"} Jul 16 00:44:35.166758 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerDied","Data":"a8c7b4f270da0e52ba153ffa47b83306c473b6471b52eb3b0a35fc95d5a5109b"} Jul 16 00:44:35.166758 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.166726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"d3cede9d6c97a69568c73417cdda261022fd0026a384eabcc49dd4df8486c0e6"} Jul 16 00:44:35.168091 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.168066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x8dvs" event={"ID":"a0897951-8421-4b59-b896-3577e922488b","Type":"ContainerStarted","Data":"73c63c5ba657668140ed4b0d2634164ec9df1bfa829e754ae1760e6f694a4c87"} Jul 16 00:44:35.169678 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.169657 2567 generic.go:356] "Generic (PLEG): container finished" podID="f6552f44da1e8da2807f6f7751b4b674" containerID="e572c2465e0417c37498b2c2a5f6caaa33d44d8cb007a372bf51f6eeb33c7e1f" exitCode=0 Jul 16 00:44:35.169783 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.169734 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" event={"ID":"f6552f44da1e8da2807f6f7751b4b674","Type":"ContainerDied","Data":"e572c2465e0417c37498b2c2a5f6caaa33d44d8cb007a372bf51f6eeb33c7e1f"} Jul 16 00:44:35.171226 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.171203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" event={"ID":"cd0a2e5a-f866-41be-b9e6-63c252918ef6","Type":"ContainerStarted","Data":"808cb7275ed284fa906ea7e1e68ef96d5805e4d6ca63ed4ad030cc66ab45d989"} Jul 16 00:44:35.172818 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.172792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xf84j" event={"ID":"bb06ec6e-d6ec-476e-840a-ffe9f0f709b9","Type":"ContainerStarted","Data":"8452b4757a0aeec7619b0bf8ca3710bb53c7dc5f77f99d2122675d9edef4c2a1"} Jul 16 00:44:35.212803 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.212754 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x8dvs" podStartSLOduration=2.890020824 podStartE2EDuration="23.212738201s" totalImagesPullingTime="20.322717377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:35.196102876 +0000 UTC m=+23.719174132" watchObservedRunningTime="2026-07-16 00:44:35.212738201 +0000 UTC m=+23.735809434" Jul 16 00:44:35.213097 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.213075 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sh2n5" podStartSLOduration=2.906613095 podStartE2EDuration="23.213069102s" totalImagesPullingTime="20.306456007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:35.212859118 +0000 UTC m=+23.735930361" watchObservedRunningTime="2026-07-16 00:44:35.213069102 +0000 UTC m=+23.736140356" Jul 16 00:44:35.231427 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.231379 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wbqs6" podStartSLOduration=2.965366118 podStartE2EDuration="23.231361176s" totalImagesPullingTime="20.265995058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:35.23106349 +0000 UTC m=+23.754134765" watchObservedRunningTime="2026-07-16 00:44:35.231361176 +0000 UTC m=+23.754432431" Jul 16 00:44:35.263643 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.263597 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xf84j" podStartSLOduration=2.917436941 podStartE2EDuration="23.26358354s" totalImagesPullingTime="20.346146599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:35.263498229 +0000 UTC m=+23.786569475" watchObservedRunningTime="2026-07-16 00:44:35.26358354 +0000 UTC m=+23.786654795" Jul 16 00:44:35.584402 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.584232 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 00:44:35.895340 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.895182 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T00:44:35.584398702Z","UUID":"288bec50-96a2-4a32-948d-14124a01ad4f","Handler":null,"Name":"","Endpoint":""} Jul 16 00:44:35.897184 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.897163 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 00:44:35.897318 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.897200 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 00:44:35.968688 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:35.968659 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:35.969171 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:35.968773 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:36.139023 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:36.138970 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:36.177801 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:36.177711 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" event={"ID":"f6552f44da1e8da2807f6f7751b4b674","Type":"ContainerStarted","Data":"027ee5b3625aed8c972277792513262dd0217fad9219351dd54be393033a3358"} Jul 16 00:44:36.181564 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:36.181536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" event={"ID":"cd0a2e5a-f866-41be-b9e6-63c252918ef6","Type":"ContainerStarted","Data":"f46b105498e5416788579dae80380394e7638317198ae32c0ee034f0d4acd551"} Jul 16 00:44:36.196120 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:36.196070 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-151.ec2.internal" podStartSLOduration=24.196050349 podStartE2EDuration="24.196050349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:36.195715736 +0000 UTC m=+24.718787004" watchObservedRunningTime="2026-07-16 00:44:36.196050349 +0000 UTC m=+24.719121605" Jul 16 00:44:36.966502 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:36.966463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:36.966778 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:36.966596 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:36.966778 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:36.966652 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:36.966778 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:36.966769 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:37.187070 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.187043 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:44:37.187639 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.187462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"6e056cf76678bd23daee42dae992bccd693fa1068ba643f62b6be827cacb9a6f"} Jul 16 00:44:37.189785 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.189758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" event={"ID":"cd0a2e5a-f866-41be-b9e6-63c252918ef6","Type":"ContainerStarted","Data":"6259a987608f496e7d370d928d8a323a70d96ffc1fe419e170687ab91f4d32ca"} Jul 16 00:44:37.235042 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.234923 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn6mz" podStartSLOduration=3.127224614 podStartE2EDuration="25.234903086s" totalImagesPullingTime="22.107678472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:37.234651518 +0000 UTC m=+25.757722769" watchObservedRunningTime="2026-07-16 00:44:37.234903086 +0000 UTC m=+25.757974345" Jul 16 00:44:37.540524 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.540443 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:37.541121 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.541101 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:37.967840 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:37.967807 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:37.968040 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:37.967932 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:38.192974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:38.192946 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sh2n5" Jul 16 00:44:38.966275 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:38.966236 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:38.966460 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:38.966237 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:38.966460 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:38.966379 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:38.966562 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:38.966473 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:39.966377 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:39.966191 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:39.966829 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:39.966483 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:40.198088 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.198052 2567 generic.go:356] "Generic (PLEG): container finished" podID="1126c224-f332-4834-816a-5d8b196bb0dd" containerID="3e6b3f2e4cb0f5c1c7309b54abcb8662316551ceafa9d149e0c87f54d04ab911" exitCode=0 Jul 16 00:44:40.198277 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.198101 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerDied","Data":"3e6b3f2e4cb0f5c1c7309b54abcb8662316551ceafa9d149e0c87f54d04ab911"} Jul 16 00:44:40.201507 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.201491 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:44:40.201972 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.201858 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"afbb56a55f79b6c8cf7244d20fe912169cdea8db891bde9b60004a804227ecab"} Jul 16 00:44:40.202308 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.202293 2567 scope.go:117] "RemoveContainer" containerID="a8c7b4f270da0e52ba153ffa47b83306c473b6471b52eb3b0a35fc95d5a5109b" Jul 16 00:44:40.966264 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.966230 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:40.966567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:40.966245 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:40.966567 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:40.966352 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:40.966567 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:40.966392 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:41.208194 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.208033 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:44:41.208474 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.208450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" event={"ID":"a6c3e6b4-3841-4609-b6f5-4dee9796eeb7","Type":"ContainerStarted","Data":"5c35034e3d4865dd196ffc264b33e81565dfa3825234237b01ddc7c54ffdb9af"} Jul 16 00:44:41.208654 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.208637 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:41.208742 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.208703 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:41.208797 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.208753 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:41.224615 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.224559 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:41.224717 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.224673 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:44:41.241768 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.241731 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" podStartSLOduration=8.164590119 podStartE2EDuration="29.241715523s" totalImagesPullingTime="21.077125404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:41.240171077 +0000 UTC m=+29.763242351" watchObservedRunningTime="2026-07-16 00:44:41.241715523 +0000 UTC m=+29.764786779" Jul 16 00:44:41.269793 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.269765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w59jq"] Jul 16 00:44:41.269917 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.269869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:41.270015 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:41.269974 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:41.274529 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.274502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nx65d"] Jul 16 00:44:41.274640 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.274597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:41.274729 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:41.274704 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:41.275218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.275191 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jrd68"] Jul 16 00:44:41.275328 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:41.275301 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:41.275435 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:41.275406 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:42.212807 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:42.212776 2567 generic.go:356] "Generic (PLEG): container finished" podID="1126c224-f332-4834-816a-5d8b196bb0dd" containerID="4d591435a1507688fbed76003bd27035538b58ec18bdb9517c320ccf7975e10e" exitCode=0 Jul 16 00:44:42.213262 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:42.212863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerDied","Data":"4d591435a1507688fbed76003bd27035538b58ec18bdb9517c320ccf7975e10e"} Jul 16 00:44:42.966565 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:42.966535 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:42.966718 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:42.966535 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:42.966718 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:42.966636 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:42.966718 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:42.966535 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:42.966718 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:42.966712 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:42.966967 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:42.966796 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:44.220161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.220076 2567 generic.go:356] "Generic (PLEG): container finished" podID="1126c224-f332-4834-816a-5d8b196bb0dd" containerID="7a0866a9d5036a2a3477aca468245114908ca020e8e6963d14e2a8f9ebdaf16b" exitCode=0 Jul 16 00:44:44.220161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.220118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerDied","Data":"7a0866a9d5036a2a3477aca468245114908ca020e8e6963d14e2a8f9ebdaf16b"} Jul 16 00:44:44.667079 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.666974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:44.667261 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.667087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:44.667261 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.667114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:44.667261 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667155 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:44.667429 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667245 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:44.667429 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667329 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wrm2p for pod openshift-network-diagnostics/network-check-target-nx65d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:44.667429 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667386 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p podName:8a098c0f-5b68-4597-ad30-3fbca4310f2c nodeName:}" failed. No retries permitted until 2026-07-16 00:45:16.66736397 +0000 UTC m=+65.190435203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrm2p" (UniqueName: "kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p") pod "network-check-target-nx65d" (UID: "8a098c0f-5b68-4597-ad30-3fbca4310f2c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:44.667429 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667217 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:44.667618 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667464 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret podName:f149c855-2cbf-4457-8785-3f1da93eeeac nodeName:}" failed. No retries permitted until 2026-07-16 00:45:16.667446012 +0000 UTC m=+65.190517253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret") pod "global-pull-secret-syncer-w59jq" (UID: "f149c855-2cbf-4457-8785-3f1da93eeeac") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:44.667618 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667221 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:44.667618 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.667506 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:45:16.667497088 +0000 UTC m=+65.190568320 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:44.966174 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.966031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:44.966174 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.966061 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:44.966174 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:44.966068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:44.966174 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.966162 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:44.966454 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.966260 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:44.966454 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:44.966350 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:46.965981 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:46.965948 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:46.965981 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:46.965976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:46.966505 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:46.966020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:46.966505 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:46.966153 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:44:46.966505 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:46.966272 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w59jq" podUID="f149c855-2cbf-4457-8785-3f1da93eeeac" Jul 16 00:44:46.966505 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:46.966354 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nx65d" podUID="8a098c0f-5b68-4597-ad30-3fbca4310f2c" Jul 16 00:44:47.780643 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.780418 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-151.ec2.internal" event="NodeReady" Jul 16 00:44:47.780812 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.780774 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 00:44:47.825206 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.825161 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c669b5c8f-rrfhv"] Jul 16 00:44:47.828048 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.828017 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.830906 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.830881 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 00:44:47.830906 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.830915 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 00:44:47.831107 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.830923 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 00:44:47.831107 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.830890 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pkjn\"" Jul 16 00:44:47.836580 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.836398 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 00:44:47.842666 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.842646 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-b9wzb"] Jul 16 00:44:47.844535 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.844514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:47.845015 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.844904 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c669b5c8f-rrfhv"] Jul 16 00:44:47.846081 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.845506 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4qklq"] Jul 16 00:44:47.846931 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.846834 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xbm2c\"" Jul 16 00:44:47.847135 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.847119 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 00:44:47.847617 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.847244 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rf782"] Jul 16 00:44:47.847617 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.847390 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 00:44:47.847617 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.847440 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:47.849122 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.849104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:47.850236 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.850219 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 00:44:47.850336 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.850278 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 00:44:47.850403 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.850356 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm4s9\"" Jul 16 00:44:47.851893 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.851830 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 00:44:47.852117 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.852097 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 00:44:47.852225 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.852199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 00:44:47.852410 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.852396 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ggldt\"" Jul 16 00:44:47.855815 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.855793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-b9wzb"] Jul 16 00:44:47.860447 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.860424 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4qklq"] Jul 16 00:44:47.873107 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.873086 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rf782"] Jul 16 00:44:47.887646 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-bound-sa-token\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.887764 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-certificates\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.887764 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20ccbe94-0ced-4710-ac49-6de293a1d07a-ca-trust-extracted\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.887764 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.887907 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xdk\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-kube-api-access-v5xdk\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.887907 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-image-registry-private-configuration\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.887907 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-trusted-ca\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.888075 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.887912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-installation-pull-secrets\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.989135 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-bound-sa-token\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-certificates\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20ccbe94-0ced-4710-ac49-6de293a1d07a-ca-trust-extracted\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2zd\" (UniqueName: \"kubernetes.io/projected/4fba8b81-6108-412d-a66e-776a8d7f7bbf-kube-api-access-9x2zd\") pod \"ingress-canary-rf782\" (UID: \"4fba8b81-6108-412d-a66e-776a8d7f7bbf\") " pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989283 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xdk\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-kube-api-access-v5xdk\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgvp5\" (UniqueName: \"kubernetes.io/projected/d9e282ad-c750-4afe-8ae8-eec443f64bbe-kube-api-access-xgvp5\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:47.989446 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:47.989466 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:47.989534 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:44:48.48951332 +0000 UTC m=+37.012584554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:44:47.989579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e282ad-c750-4afe-8ae8-eec443f64bbe-tmp-dir\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-image-registry-private-configuration\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989623 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20ccbe94-0ced-4710-ac49-6de293a1d07a-ca-trust-extracted\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-trusted-ca\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-installation-pull-secrets\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e282ad-c750-4afe-8ae8-eec443f64bbe-config-volume\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fba8b81-6108-412d-a66e-776a8d7f7bbf-cert\") pod \"ingress-canary-rf782\" (UID: \"4fba8b81-6108-412d-a66e-776a8d7f7bbf\") " pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.989904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/081b3ae8-51d3-47b8-8052-9756455f564f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:47.990130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.990038 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-certificates\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.990625 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.990599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-trusted-ca\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.994767 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.994743 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-installation-pull-secrets\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.995512 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.995495 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-image-registry-private-configuration\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.998242 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.998224 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xdk\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-kube-api-access-v5xdk\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:47.998318 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:47.998249 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-bound-sa-token\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:48.090499 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.090687 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e282ad-c750-4afe-8ae8-eec443f64bbe-config-volume\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.090687 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fba8b81-6108-412d-a66e-776a8d7f7bbf-cert\") pod \"ingress-canary-rf782\" (UID: \"4fba8b81-6108-412d-a66e-776a8d7f7bbf\") " pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:48.090687 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.090635 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:48.090687 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/081b3ae8-51d3-47b8-8052-9756455f564f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:48.090893 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.090707 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:44:48.590686564 +0000 UTC m=+37.113757797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:44:48.090893 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:48.090893 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2zd\" (UniqueName: \"kubernetes.io/projected/4fba8b81-6108-412d-a66e-776a8d7f7bbf-kube-api-access-9x2zd\") pod \"ingress-canary-rf782\" (UID: \"4fba8b81-6108-412d-a66e-776a8d7f7bbf\") " pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:48.090893 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgvp5\" (UniqueName: \"kubernetes.io/projected/d9e282ad-c750-4afe-8ae8-eec443f64bbe-kube-api-access-xgvp5\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.091131 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.090904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e282ad-c750-4afe-8ae8-eec443f64bbe-tmp-dir\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.091131 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.090942 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:44:48.091131 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.091010 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:48.590981115 +0000 UTC m=+37.114052349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:44:48.091283 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.091213 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e282ad-c750-4afe-8ae8-eec443f64bbe-tmp-dir\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.091283 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.091221 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e282ad-c750-4afe-8ae8-eec443f64bbe-config-volume\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.091410 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.091392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/081b3ae8-51d3-47b8-8052-9756455f564f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:48.093365 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.093340 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fba8b81-6108-412d-a66e-776a8d7f7bbf-cert\") pod \"ingress-canary-rf782\" (UID: \"4fba8b81-6108-412d-a66e-776a8d7f7bbf\") " pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:48.110465 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.110403 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgvp5\" (UniqueName: \"kubernetes.io/projected/d9e282ad-c750-4afe-8ae8-eec443f64bbe-kube-api-access-xgvp5\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.111226 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.111208 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2zd\" (UniqueName: \"kubernetes.io/projected/4fba8b81-6108-412d-a66e-776a8d7f7bbf-kube-api-access-9x2zd\") pod \"ingress-canary-rf782\" (UID: \"4fba8b81-6108-412d-a66e-776a8d7f7bbf\") " pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:48.170473 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.170442 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rf782" Jul 16 00:44:48.312327 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.312291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rf782"] Jul 16 00:44:48.318263 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:44:48.318241 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fba8b81_6108_412d_a66e_776a8d7f7bbf.slice/crio-ca91f9ff14f91e7f88553e58b7efbd3406c8c4f2bc4d310595f76ae64d92bbe6 WatchSource:0}: Error finding container ca91f9ff14f91e7f88553e58b7efbd3406c8c4f2bc4d310595f76ae64d92bbe6: Status 404 returned error can't find the container with id ca91f9ff14f91e7f88553e58b7efbd3406c8c4f2bc4d310595f76ae64d92bbe6 Jul 16 00:44:48.494024 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.493978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:48.494189 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.494149 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:44:48.494189 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.494171 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:44:48.494294 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.494283 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:44:49.49425954 +0000 UTC m=+38.017330776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:44:48.594904 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.594866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:48.595089 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.594930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:48.595089 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.595032 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:48.595089 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.595060 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:44:48.595193 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.595097 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:44:49.595079692 +0000 UTC m=+38.118150925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:44:48.595193 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:48.595116 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:49.595103494 +0000 UTC m=+38.118174726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:44:48.966582 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.966544 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:44:48.966582 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.966581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:44:48.966811 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.966581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:44:48.969656 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.969635 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:44:48.969776 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.969692 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:44:48.969776 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.969698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:44:48.969888 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.969880 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b92gb\"" Jul 16 00:44:48.969942 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.969892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48jwq\"" Jul 16 00:44:48.969942 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:48.969928 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:44:49.234508 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:49.234195 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rf782" event={"ID":"4fba8b81-6108-412d-a66e-776a8d7f7bbf","Type":"ContainerStarted","Data":"ca91f9ff14f91e7f88553e58b7efbd3406c8c4f2bc4d310595f76ae64d92bbe6"} Jul 16 00:44:49.237319 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:49.237289 2567 generic.go:356] "Generic (PLEG): container finished" podID="1126c224-f332-4834-816a-5d8b196bb0dd" containerID="c961b167a3c4588a07752c2e791d9aa810f10432d1e6144d263d353e0d33ea71" exitCode=0 Jul 16 00:44:49.237455 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:49.237360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerDied","Data":"c961b167a3c4588a07752c2e791d9aa810f10432d1e6144d263d353e0d33ea71"} Jul 16 00:44:49.505034 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:49.504939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:49.505200 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.505103 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:44:49.505200 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.505124 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:44:49.505200 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.505192 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:44:51.505171703 +0000 UTC m=+40.028242955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:44:49.605700 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:49.605669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:49.605851 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:49.605723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:49.605851 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.605839 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:44:49.605851 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.605841 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:49.605960 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.605894 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:51.605880748 +0000 UTC m=+40.128951985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:44:49.605960 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:49.605907 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:44:51.605901453 +0000 UTC m=+40.128972686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:44:50.243363 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:50.243277 2567 generic.go:356] "Generic (PLEG): container finished" podID="1126c224-f332-4834-816a-5d8b196bb0dd" containerID="d4f8c7e9458f0fd9d29230e2d8a51689a02c58c2f6c1d521847439dc993b2e01" exitCode=0 Jul 16 00:44:50.243363 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:50.243355 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerDied","Data":"d4f8c7e9458f0fd9d29230e2d8a51689a02c58c2f6c1d521847439dc993b2e01"} Jul 16 00:44:51.247431 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.247397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rf782" event={"ID":"4fba8b81-6108-412d-a66e-776a8d7f7bbf","Type":"ContainerStarted","Data":"e0e969147189a734487227109007c948a8a1632ca1157e5db34a85b27cfe3ba7"} Jul 16 00:44:51.250395 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.250370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" event={"ID":"1126c224-f332-4834-816a-5d8b196bb0dd","Type":"ContainerStarted","Data":"ecc5f3d164088fcfe522a84583c0dc9c3aca338bcac8697cfc35ae3d9dd158e0"} Jul 16 00:44:51.265109 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.265071 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rf782" podStartSLOduration=1.8196385830000001 podStartE2EDuration="4.26505732s" totalImagesPullingTime="2.445418737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:51.26433385 +0000 UTC m=+39.787405106" watchObservedRunningTime="2026-07-16 00:44:51.26505732 +0000 UTC m=+39.788128576" Jul 16 00:44:51.287219 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.287167 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8zbnr" podStartSLOduration=8.619843829 podStartE2EDuration="39.287147282s" totalImagesPullingTime="30.667303453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:51.286193435 +0000 UTC m=+39.809264691" watchObservedRunningTime="2026-07-16 00:44:51.287147282 +0000 UTC m=+39.810218538" Jul 16 00:44:51.522930 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.522681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:51.522930 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.522831 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:44:51.522930 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.522920 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:44:51.523166 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.522974 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:44:55.522959895 +0000 UTC m=+44.046031130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:44:51.623544 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.623505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:51.623685 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:51.623613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:51.623685 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.623663 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:44:51.623768 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.623704 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:51.623768 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.623739 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:44:55.62371892 +0000 UTC m=+44.146790172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:44:51.623768 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:51.623756 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:44:55.623747833 +0000 UTC m=+44.146819070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:44:55.555248 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.555203 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:44:55.555738 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.555721 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:44:55.555889 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.555877 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:45:03.555855985 +0000 UTC m=+52.078927239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:44:55.556491 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:55.556468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:44:55.657174 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:55.657129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:44:55.657345 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:44:55.657216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:44:55.657345 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.657278 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:44:55.657345 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.657321 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:55.657438 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.657347 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:45:03.657330331 +0000 UTC m=+52.180401564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:44:55.657438 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:44:55.657366 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:45:03.657355748 +0000 UTC m=+52.180426980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:45:03.620424 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:03.620383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:45:03.621095 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.620541 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:45:03.621095 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.620559 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:45:03.621095 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.620623 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:45:19.620608015 +0000 UTC m=+68.143679249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:45:03.720847 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:03.720806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:45:03.721074 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:03.720884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:45:03.721074 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.720977 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:03.721074 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.721060 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:45:19.721044941 +0000 UTC m=+68.244116175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:45:03.721230 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.720977 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:45:03.721230 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:03.721159 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:45:19.721142028 +0000 UTC m=+68.244213275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:45:13.237431 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:13.237399 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xjs85" Jul 16 00:45:16.710321 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.710279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:45:16.710321 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.710320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:45:16.710810 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.710345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:45:16.713404 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.713381 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:45:16.713485 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.713415 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:45:16.713485 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.713393 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:45:16.720670 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:16.720651 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:45:16.720777 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:16.720706 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:46:20.720690789 +0000 UTC m=+129.243762024 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : secret "metrics-daemon-secret" not found Jul 16 00:45:16.723185 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.723171 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:45:16.724579 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.724553 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f149c855-2cbf-4457-8785-3f1da93eeeac-original-pull-secret\") pod \"global-pull-secret-syncer-w59jq\" (UID: \"f149c855-2cbf-4457-8785-3f1da93eeeac\") " pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:45:16.733470 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.733451 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrm2p\" (UniqueName: \"kubernetes.io/projected/8a098c0f-5b68-4597-ad30-3fbca4310f2c-kube-api-access-wrm2p\") pod \"network-check-target-nx65d\" (UID: \"8a098c0f-5b68-4597-ad30-3fbca4310f2c\") " pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:45:16.878652 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.878617 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w59jq" Jul 16 00:45:16.893329 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.893303 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48jwq\"" Jul 16 00:45:16.900931 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:16.900905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:45:17.016935 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:17.016904 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w59jq"] Jul 16 00:45:17.019660 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:45:17.019633 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf149c855_2cbf_4457_8785_3f1da93eeeac.slice/crio-fd3c27d9c5d5bb92664e400abc3ffd49199a2c3f31ad1941c7b0ab34b3f056dc WatchSource:0}: Error finding container fd3c27d9c5d5bb92664e400abc3ffd49199a2c3f31ad1941c7b0ab34b3f056dc: Status 404 returned error can't find the container with id fd3c27d9c5d5bb92664e400abc3ffd49199a2c3f31ad1941c7b0ab34b3f056dc Jul 16 00:45:17.032080 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:17.032056 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nx65d"] Jul 16 00:45:17.034906 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:45:17.034884 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a098c0f_5b68_4597_ad30_3fbca4310f2c.slice/crio-36ea632d17ca34c024454e565654d7393a933dfb7cf85eb4036eac4af232af39 WatchSource:0}: Error finding container 36ea632d17ca34c024454e565654d7393a933dfb7cf85eb4036eac4af232af39: Status 404 returned error can't find the container with id 36ea632d17ca34c024454e565654d7393a933dfb7cf85eb4036eac4af232af39 Jul 16 00:45:17.313224 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:17.313129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w59jq" event={"ID":"f149c855-2cbf-4457-8785-3f1da93eeeac","Type":"ContainerStarted","Data":"fd3c27d9c5d5bb92664e400abc3ffd49199a2c3f31ad1941c7b0ab34b3f056dc"} Jul 16 00:45:17.314127 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:17.314104 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nx65d" event={"ID":"8a098c0f-5b68-4597-ad30-3fbca4310f2c","Type":"ContainerStarted","Data":"36ea632d17ca34c024454e565654d7393a933dfb7cf85eb4036eac4af232af39"} Jul 16 00:45:19.628826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:19.628770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:45:19.629304 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.629033 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:45:19.629304 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.629048 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:45:19.629304 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.629106 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:45:51.629088885 +0000 UTC m=+100.152160122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:45:19.729901 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:19.729854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:45:19.730128 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:19.729944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:45:19.730194 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.730169 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:45:19.730267 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.730255 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:45:51.730240271 +0000 UTC m=+100.253311503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:45:19.730647 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.730624 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:19.730783 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:19.730671 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:45:51.730656075 +0000 UTC m=+100.253727309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:45:22.329549 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:22.329513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nx65d" event={"ID":"8a098c0f-5b68-4597-ad30-3fbca4310f2c","Type":"ContainerStarted","Data":"85c5127ef33da1e87e50f8e0947444855eb42a76ed012ca7c7944e41638ce087"} Jul 16 00:45:22.330100 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:22.329597 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:45:22.330974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:22.330956 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w59jq" event={"ID":"f149c855-2cbf-4457-8785-3f1da93eeeac","Type":"ContainerStarted","Data":"6f03ba590e7f80b4e12f0f5a4f1a17cf5faa22b3536802a1f7e41c112429aae1"} Jul 16 00:45:22.345844 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:22.345804 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nx65d" podStartSLOduration=66.57013141 podStartE2EDuration="1m11.345787801s" totalImagesPullingTime="4.775656391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:22.345597071 +0000 UTC m=+70.868668339" watchObservedRunningTime="2026-07-16 00:45:22.345787801 +0000 UTC m=+70.868859057" Jul 16 00:45:22.361252 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:22.361184 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w59jq" podStartSLOduration=65.559424514 podStartE2EDuration="1m10.361162533s" totalImagesPullingTime="4.801738019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:22.361063657 +0000 UTC m=+70.884134913" watchObservedRunningTime="2026-07-16 00:45:22.361162533 +0000 UTC m=+70.884233789" Jul 16 00:45:23.226727 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.226692 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q"] Jul 16 00:45:23.228534 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.228516 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.231567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.231548 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 00:45:23.232354 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.232327 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 00:45:23.232354 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.232337 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 00:45:23.232519 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.232414 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 00:45:23.241077 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.241054 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q"] Jul 16 00:45:23.251408 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.251353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.251541 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.251437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk2nx\" (UniqueName: \"kubernetes.io/projected/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-kube-api-access-bk2nx\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.251541 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.251497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-tmp\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.351842 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.351803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.351842 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.351845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk2nx\" (UniqueName: \"kubernetes.io/projected/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-kube-api-access-bk2nx\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.352390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.352067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-tmp\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.352390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.352359 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-tmp\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.354455 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.354431 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.360149 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.360125 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk2nx\" (UniqueName: \"kubernetes.io/projected/68ef5fb8-a8a4-461b-9468-6bab86fca6a5-kube-api-access-bk2nx\") pod \"klusterlet-addon-workmgr-5f444f88f6-wfh2q\" (UID: \"68ef5fb8-a8a4-461b-9468-6bab86fca6a5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.537302 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.537202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:23.663482 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:23.663449 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q"] Jul 16 00:45:23.666531 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:45:23.666491 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ef5fb8_a8a4_461b_9468_6bab86fca6a5.slice/crio-e9dac22200bdb08a42c49d059441cfbeacf801abf51ddb07f53fae5847e91a83 WatchSource:0}: Error finding container e9dac22200bdb08a42c49d059441cfbeacf801abf51ddb07f53fae5847e91a83: Status 404 returned error can't find the container with id e9dac22200bdb08a42c49d059441cfbeacf801abf51ddb07f53fae5847e91a83 Jul 16 00:45:24.336874 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:24.336837 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" event={"ID":"68ef5fb8-a8a4-461b-9468-6bab86fca6a5","Type":"ContainerStarted","Data":"e9dac22200bdb08a42c49d059441cfbeacf801abf51ddb07f53fae5847e91a83"} Jul 16 00:45:27.346660 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:27.346623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" event={"ID":"68ef5fb8-a8a4-461b-9468-6bab86fca6a5","Type":"ContainerStarted","Data":"73c03bfdacb4c279e83df832a5e3c00abbbad9ec3425cf0cf34fffa6fece9076"} Jul 16 00:45:27.347063 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:27.346864 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:27.348075 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:27.348046 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:45:27.363137 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:27.363095 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" podStartSLOduration=0.794324826 podStartE2EDuration="4.36308096s" totalImagesPullingTime="3.568756134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:27.361674224 +0000 UTC m=+75.884745478" watchObservedRunningTime="2026-07-16 00:45:27.36308096 +0000 UTC m=+75.886152214" Jul 16 00:45:51.663268 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:51.663229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:45:51.663677 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.663402 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:45:51.663677 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.663423 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:45:51.663677 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.663494 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:46:55.66347697 +0000 UTC m=+164.186548203 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:45:51.764084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:51.764037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:45:51.764187 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:51.764130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:45:51.764222 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.764193 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:45:51.764255 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.764223 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:51.764286 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.764271 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:46:55.764253598 +0000 UTC m=+164.287324833 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:45:51.764286 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:45:51.764285 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:46:55.764279006 +0000 UTC m=+164.287350239 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:45:53.335618 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:45:53.335588 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nx65d" Jul 16 00:46:20.777126 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:20.777083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:46:20.777518 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:20.777210 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:46:20.777518 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:20.777264 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:22.777250767 +0000 UTC m=+251.300322000 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : secret "metrics-daemon-secret" not found Jul 16 00:46:50.840448 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:50.840407 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" Jul 16 00:46:50.857566 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:50.857536 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" podUID="081b3ae8-51d3-47b8-8052-9756455f564f" Jul 16 00:46:50.864657 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:50.864636 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4qklq" podUID="d9e282ad-c750-4afe-8ae8-eec443f64bbe" Jul 16 00:46:51.549673 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:51.549643 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:46:51.549673 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:51.549663 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:46:51.549879 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:51.549649 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4qklq" Jul 16 00:46:51.985002 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:51.984956 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:46:55.723441 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:55.722205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:46:55.723441 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.722389 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:46:55.723441 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.722405 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c669b5c8f-rrfhv: secret "image-registry-tls" not found Jul 16 00:46:55.723441 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.722496 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls podName:20ccbe94-0ced-4710-ac49-6de293a1d07a nodeName:}" failed. No retries permitted until 2026-07-16 00:48:57.722474711 +0000 UTC m=+286.245545961 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls") pod "image-registry-c669b5c8f-rrfhv" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a") : secret "image-registry-tls" not found Jul 16 00:46:55.823219 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:55.823183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:46:55.823387 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:46:55.823239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:46:55.823387 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.823332 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:46:55.823387 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.823364 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:46:55.823487 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.823402 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls podName:d9e282ad-c750-4afe-8ae8-eec443f64bbe nodeName:}" failed. No retries permitted until 2026-07-16 00:48:57.823387401 +0000 UTC m=+286.346458638 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls") pod "dns-default-4qklq" (UID: "d9e282ad-c750-4afe-8ae8-eec443f64bbe") : secret "dns-default-metrics-tls" not found Jul 16 00:46:55.823487 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:46:55.823420 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert podName:081b3ae8-51d3-47b8-8052-9756455f564f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:57.823407868 +0000 UTC m=+286.346479101 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-b9wzb" (UID: "081b3ae8-51d3-47b8-8052-9756455f564f") : secret "networking-console-plugin-cert" not found Jul 16 00:47:03.966985 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:03.966892 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:47:27.347768 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:27.347727 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" podUID="68ef5fb8-a8a4-461b-9468-6bab86fca6a5" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jul 16 00:47:27.636620 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:27.636591 2567 generic.go:356] "Generic (PLEG): container finished" podID="68ef5fb8-a8a4-461b-9468-6bab86fca6a5" containerID="73c03bfdacb4c279e83df832a5e3c00abbbad9ec3425cf0cf34fffa6fece9076" exitCode=1 Jul 16 00:47:27.636759 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:27.636632 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" event={"ID":"68ef5fb8-a8a4-461b-9468-6bab86fca6a5","Type":"ContainerDied","Data":"73c03bfdacb4c279e83df832a5e3c00abbbad9ec3425cf0cf34fffa6fece9076"} Jul 16 00:47:27.636942 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:27.636922 2567 scope.go:117] "RemoveContainer" containerID="73c03bfdacb4c279e83df832a5e3c00abbbad9ec3425cf0cf34fffa6fece9076" Jul 16 00:47:28.640936 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:28.640903 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" event={"ID":"68ef5fb8-a8a4-461b-9468-6bab86fca6a5","Type":"ContainerStarted","Data":"2ba09b346e6597b54df5eac183b6a9b01c927afe58ada88d7c851a0fea6daf11"} Jul 16 00:47:28.641381 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:28.641156 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:47:28.641796 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:47:28.641778 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f444f88f6-wfh2q" Jul 16 00:48:22.827808 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:22.827770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:48:22.828332 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:22.827878 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:48:22.828332 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:22.827939 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs podName:58057755-9524-460e-975f-3e1aa107842f nodeName:}" failed. No retries permitted until 2026-07-16 00:50:24.827924056 +0000 UTC m=+373.350995290 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs") pod "network-metrics-daemon-jrd68" (UID: "58057755-9524-460e-975f-3e1aa107842f") : secret "metrics-daemon-secret" not found Jul 16 00:48:30.077917 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.077881 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz"] Jul 16 00:48:30.079719 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.079700 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" Jul 16 00:48:30.082799 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.082780 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6mvmh\"" Jul 16 00:48:30.098057 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.098030 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz"] Jul 16 00:48:30.173560 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.173520 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd"] Jul 16 00:48:30.175419 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.175398 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.177343 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.177318 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl"] Jul 16 00:48:30.179109 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.179091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.180828 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.180805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf09d64-b3a0-4ef6-82f2-801119318d43-serving-cert\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.180937 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.180894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf09d64-b3a0-4ef6-82f2-801119318d43-config\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.180937 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.180929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7pdx\" (UniqueName: \"kubernetes.io/projected/93e773d5-111b-4a68-abce-345b13f974c6-kube-api-access-s7pdx\") pod \"network-check-source-869dcfcdcd-pr2fz\" (UID: \"93e773d5-111b-4a68-abce-345b13f974c6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" Jul 16 00:48:30.181093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.181030 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw86m\" (UniqueName: \"kubernetes.io/projected/4cf09d64-b3a0-4ef6-82f2-801119318d43-kube-api-access-qw86m\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.181983 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.181963 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 00:48:30.182320 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.182179 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 00:48:30.182320 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.182282 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-95kgh\"" Jul 16 00:48:30.182452 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.182435 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 00:48:30.183477 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.183458 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 00:48:30.183569 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.183488 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:48:30.183569 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.183495 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 00:48:30.183918 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.183900 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 00:48:30.184044 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.183962 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 00:48:30.198141 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.198117 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd"] Jul 16 00:48:30.199396 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.199378 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jg6wd\"" Jul 16 00:48:30.216908 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.216876 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl"] Jul 16 00:48:30.281536 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v97q9\" (UniqueName: \"kubernetes.io/projected/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-kube-api-access-v97q9\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.281701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.281701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf09d64-b3a0-4ef6-82f2-801119318d43-config\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.281701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7pdx\" (UniqueName: \"kubernetes.io/projected/93e773d5-111b-4a68-abce-345b13f974c6-kube-api-access-s7pdx\") pod \"network-check-source-869dcfcdcd-pr2fz\" (UID: \"93e773d5-111b-4a68-abce-345b13f974c6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" Jul 16 00:48:30.281701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw86m\" (UniqueName: \"kubernetes.io/projected/4cf09d64-b3a0-4ef6-82f2-801119318d43-kube-api-access-qw86m\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.281862 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.281862 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.281746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf09d64-b3a0-4ef6-82f2-801119318d43-serving-cert\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.282228 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.282210 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf09d64-b3a0-4ef6-82f2-801119318d43-config\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.284022 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.284003 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf09d64-b3a0-4ef6-82f2-801119318d43-serving-cert\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.290276 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.290252 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw86m\" (UniqueName: \"kubernetes.io/projected/4cf09d64-b3a0-4ef6-82f2-801119318d43-kube-api-access-qw86m\") pod \"service-ca-operator-7695fc6c8c-4rhzd\" (UID: \"4cf09d64-b3a0-4ef6-82f2-801119318d43\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.290517 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.290498 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7pdx\" (UniqueName: \"kubernetes.io/projected/93e773d5-111b-4a68-abce-345b13f974c6-kube-api-access-s7pdx\") pod \"network-check-source-869dcfcdcd-pr2fz\" (UID: \"93e773d5-111b-4a68-abce-345b13f974c6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" Jul 16 00:48:30.382701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.382665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.382701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.382711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v97q9\" (UniqueName: \"kubernetes.io/projected/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-kube-api-access-v97q9\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.382919 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:30.382816 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:30.382919 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.382842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.382919 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:30.382884 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls podName:2ee9bc73-ab95-47cc-94ca-385dcf41b26c nodeName:}" failed. No retries permitted until 2026-07-16 00:48:30.882867523 +0000 UTC m=+259.405938756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9rnzl" (UID: "2ee9bc73-ab95-47cc-94ca-385dcf41b26c") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:30.383539 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.383520 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.388066 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.388038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" Jul 16 00:48:30.392175 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.392158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v97q9\" (UniqueName: \"kubernetes.io/projected/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-kube-api-access-v97q9\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.485325 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.485297 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" Jul 16 00:48:30.510643 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.510612 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz"] Jul 16 00:48:30.513503 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:30.513477 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e773d5_111b_4a68_abce_345b13f974c6.slice/crio-e9d9735075cab096c6c85f9823da473e0481824d0a483bae4e77eeff40bb9e07 WatchSource:0}: Error finding container e9d9735075cab096c6c85f9823da473e0481824d0a483bae4e77eeff40bb9e07: Status 404 returned error can't find the container with id e9d9735075cab096c6c85f9823da473e0481824d0a483bae4e77eeff40bb9e07 Jul 16 00:48:30.618136 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.618106 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd"] Jul 16 00:48:30.620905 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:30.620880 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf09d64_b3a0_4ef6_82f2_801119318d43.slice/crio-666c557dcec0982ad116ee16820b433f803404c0c0873c9f7671a77dfd7e23a1 WatchSource:0}: Error finding container 666c557dcec0982ad116ee16820b433f803404c0c0873c9f7671a77dfd7e23a1: Status 404 returned error can't find the container with id 666c557dcec0982ad116ee16820b433f803404c0c0873c9f7671a77dfd7e23a1 Jul 16 00:48:30.807057 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.806947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" event={"ID":"4cf09d64-b3a0-4ef6-82f2-801119318d43","Type":"ContainerStarted","Data":"666c557dcec0982ad116ee16820b433f803404c0c0873c9f7671a77dfd7e23a1"} Jul 16 00:48:30.808415 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.808390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" event={"ID":"93e773d5-111b-4a68-abce-345b13f974c6","Type":"ContainerStarted","Data":"937a77438e9c2657f63aa126f799f770bd2211461f0f5eed4c5d1c5d6d21fa80"} Jul 16 00:48:30.808560 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.808428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" event={"ID":"93e773d5-111b-4a68-abce-345b13f974c6","Type":"ContainerStarted","Data":"e9d9735075cab096c6c85f9823da473e0481824d0a483bae4e77eeff40bb9e07"} Jul 16 00:48:30.826095 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.826044 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-pr2fz" podStartSLOduration=0.826028822 podStartE2EDuration="826.028822ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:30.825653442 +0000 UTC m=+259.348724722" watchObservedRunningTime="2026-07-16 00:48:30.826028822 +0000 UTC m=+259.349100077" Jul 16 00:48:30.886217 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:30.886186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:30.886377 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:30.886313 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:30.886377 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:30.886363 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls podName:2ee9bc73-ab95-47cc-94ca-385dcf41b26c nodeName:}" failed. No retries permitted until 2026-07-16 00:48:31.886350202 +0000 UTC m=+260.409421438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9rnzl" (UID: "2ee9bc73-ab95-47cc-94ca-385dcf41b26c") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:31.894108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:31.894072 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:31.894584 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:31.894250 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:31.894584 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:31.894333 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls podName:2ee9bc73-ab95-47cc-94ca-385dcf41b26c nodeName:}" failed. No retries permitted until 2026-07-16 00:48:33.894313447 +0000 UTC m=+262.417384680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9rnzl" (UID: "2ee9bc73-ab95-47cc-94ca-385dcf41b26c") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:32.815370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:32.815328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" event={"ID":"4cf09d64-b3a0-4ef6-82f2-801119318d43","Type":"ContainerStarted","Data":"154f6ed9d07ab530853bc0d88e511c5e600626775866e40c7f05e6cebca6d3bb"} Jul 16 00:48:32.838583 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:32.838531 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" podStartSLOduration=0.857088158 podStartE2EDuration="2.8385166s" totalImagesPullingTime="1.981428442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:32.837757463 +0000 UTC m=+261.360828719" watchObservedRunningTime="2026-07-16 00:48:32.8385166 +0000 UTC m=+261.361587871" Jul 16 00:48:33.908250 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:33.908188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:33.908743 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:33.908377 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:33.908743 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:33.908453 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls podName:2ee9bc73-ab95-47cc-94ca-385dcf41b26c nodeName:}" failed. No retries permitted until 2026-07-16 00:48:37.908432936 +0000 UTC m=+266.431504193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9rnzl" (UID: "2ee9bc73-ab95-47cc-94ca-385dcf41b26c") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:35.165594 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.165557 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vmk7q"] Jul 16 00:48:35.167656 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.167638 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.169889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.169859 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 00:48:35.170020 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.169891 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 00:48:35.170020 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.169972 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 00:48:35.170730 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.170715 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 00:48:35.170841 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.170749 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vt48n\"" Jul 16 00:48:35.182343 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.182311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vmk7q"] Jul 16 00:48:35.221100 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.221069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.221232 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.221127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1da5ddfa-1d35-46e1-80a4-11d20858e00f-crio-socket\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.221232 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.221190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1da5ddfa-1d35-46e1-80a4-11d20858e00f-data-volume\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.221326 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.221249 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.221326 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.221308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcb5q\" (UniqueName: \"kubernetes.io/projected/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-api-access-jcb5q\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.318170 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.318135 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj"] Jul 16 00:48:35.320200 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.320185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" Jul 16 00:48:35.322462 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322438 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1da5ddfa-1d35-46e1-80a4-11d20858e00f-data-volume\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.322570 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.322570 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcb5q\" (UniqueName: \"kubernetes.io/projected/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-api-access-jcb5q\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.322570 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322557 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.322732 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1da5ddfa-1d35-46e1-80a4-11d20858e00f-crio-socket\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.322732 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.322644 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:35.322732 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322664 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1da5ddfa-1d35-46e1-80a4-11d20858e00f-crio-socket\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.322732 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.322679 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.322732 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.322721 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.822702398 +0000 UTC m=+264.345773633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : configmap "kube-rbac-proxy" not found Jul 16 00:48:35.322935 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.322740 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.822729863 +0000 UTC m=+264.345801098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.322935 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.322742 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1da5ddfa-1d35-46e1-80a4-11d20858e00f-data-volume\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.323072 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.323053 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 00:48:35.323131 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.323104 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 00:48:35.323228 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.323209 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tzznr\"" Jul 16 00:48:35.332414 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.332390 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj"] Jul 16 00:48:35.341664 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.341637 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcb5q\" (UniqueName: \"kubernetes.io/projected/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-api-access-jcb5q\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.423059 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.422956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8z9\" (UniqueName: \"kubernetes.io/projected/79949238-f5fd-4d66-beca-4975e978b2f3-kube-api-access-kk8z9\") pod \"migrator-7f59b54f6c-txfrj\" (UID: \"79949238-f5fd-4d66-beca-4975e978b2f3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" Jul 16 00:48:35.524071 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.524035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8z9\" (UniqueName: \"kubernetes.io/projected/79949238-f5fd-4d66-beca-4975e978b2f3-kube-api-access-kk8z9\") pod \"migrator-7f59b54f6c-txfrj\" (UID: \"79949238-f5fd-4d66-beca-4975e978b2f3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" Jul 16 00:48:35.532542 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.532520 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8z9\" (UniqueName: \"kubernetes.io/projected/79949238-f5fd-4d66-beca-4975e978b2f3-kube-api-access-kk8z9\") pod \"migrator-7f59b54f6c-txfrj\" (UID: \"79949238-f5fd-4d66-beca-4975e978b2f3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" Jul 16 00:48:35.628961 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.628921 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" Jul 16 00:48:35.771216 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.771192 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj"] Jul 16 00:48:35.773722 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:35.773694 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79949238_f5fd_4d66_beca_4975e978b2f3.slice/crio-984026f4bbe15eda5c47ce422a0a1e4abaa5894f0df1e1f91c66fc20233af885 WatchSource:0}: Error finding container 984026f4bbe15eda5c47ce422a0a1e4abaa5894f0df1e1f91c66fc20233af885: Status 404 returned error can't find the container with id 984026f4bbe15eda5c47ce422a0a1e4abaa5894f0df1e1f91c66fc20233af885 Jul 16 00:48:35.824611 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.824581 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" event={"ID":"79949238-f5fd-4d66-beca-4975e978b2f3","Type":"ContainerStarted","Data":"984026f4bbe15eda5c47ce422a0a1e4abaa5894f0df1e1f91c66fc20233af885"} Jul 16 00:48:35.825907 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.825889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.825973 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:35.825957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:35.826035 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.826015 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:35.826087 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.826061 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.826087 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.826070 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:36.826055728 +0000 UTC m=+265.349126961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : configmap "kube-rbac-proxy" not found Jul 16 00:48:35.826170 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:35.826098 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:36.82608809 +0000 UTC m=+265.349159323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:36.835078 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:36.835044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:36.835446 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:36.835153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:36.835446 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:36.835173 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:36.835446 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:36.835236 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:38.835217142 +0000 UTC m=+267.358288398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : configmap "kube-rbac-proxy" not found Jul 16 00:48:36.835446 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:36.835313 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:36.835446 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:36.835371 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:38.835355876 +0000 UTC m=+267.358427130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:37.354160 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:37.354134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbqs6_dbd11bec-57fe-4279-ac17-c46468899f03/dns-node-resolver/0.log" Jul 16 00:48:37.834559 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:37.834474 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" event={"ID":"79949238-f5fd-4d66-beca-4975e978b2f3","Type":"ContainerStarted","Data":"fc0f6aa52fd59fa3ad99079540f452bef91df74655b47383a310abf90217cb4c"} Jul 16 00:48:37.834559 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:37.834524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" event={"ID":"79949238-f5fd-4d66-beca-4975e978b2f3","Type":"ContainerStarted","Data":"b3ba045a72e34b237a84c80e87d4a6aeba464cb60b5eec6b98dbb00f2dd98da1"} Jul 16 00:48:37.853355 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:37.853292 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-txfrj" podStartSLOduration=1.7508146770000002 podStartE2EDuration="2.853276569s" totalImagesPullingTime="1.102461892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:37.852607553 +0000 UTC m=+266.375678807" watchObservedRunningTime="2026-07-16 00:48:37.853276569 +0000 UTC m=+266.376347855" Jul 16 00:48:37.944291 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:37.944251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:37.944456 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:37.944402 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:37.944497 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:37.944469 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls podName:2ee9bc73-ab95-47cc-94ca-385dcf41b26c nodeName:}" failed. No retries permitted until 2026-07-16 00:48:45.94445316 +0000 UTC m=+274.467524409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9rnzl" (UID: "2ee9bc73-ab95-47cc-94ca-385dcf41b26c") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:38.354584 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:38.354556 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xf84j_bb06ec6e-d6ec-476e-840a-ffe9f0f709b9/node-ca/0.log" Jul 16 00:48:38.852066 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:38.852037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:38.852251 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:38.852148 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:38.852251 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:38.852204 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:42.85219004 +0000 UTC m=+271.375261273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : configmap "kube-rbac-proxy" not found Jul 16 00:48:38.852251 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:38.852147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:38.852251 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:38.852231 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:38.852420 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:38.852289 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:42.852273945 +0000 UTC m=+271.375345178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:39.154061 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:39.153959 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rf782_4fba8b81-6108-412d-a66e-776a8d7f7bbf/serve-healthcheck-canary/0.log" Jul 16 00:48:42.885115 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:42.885088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:42.885511 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:42.885165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:42.885511 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:42.885207 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:42.885511 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:42.885276 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:50.885259552 +0000 UTC m=+279.408330788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : configmap "kube-rbac-proxy" not found Jul 16 00:48:42.885511 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:42.885281 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:42.885511 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:42.885321 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls podName:1da5ddfa-1d35-46e1-80a4-11d20858e00f nodeName:}" failed. No retries permitted until 2026-07-16 00:48:50.885310483 +0000 UTC m=+279.408381719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vmk7q" (UID: "1da5ddfa-1d35-46e1-80a4-11d20858e00f") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:46.009689 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:46.009655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:48:46.010095 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:46.009813 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:46.010095 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:46.009879 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls podName:2ee9bc73-ab95-47cc-94ca-385dcf41b26c nodeName:}" failed. No retries permitted until 2026-07-16 00:49:02.009864373 +0000 UTC m=+290.532935607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9rnzl" (UID: "2ee9bc73-ab95-47cc-94ca-385dcf41b26c") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:48:50.949115 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:50.949066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:50.949600 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:50.949188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:50.949600 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:50.949570 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1da5ddfa-1d35-46e1-80a4-11d20858e00f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:50.951554 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:50.951535 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1da5ddfa-1d35-46e1-80a4-11d20858e00f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vmk7q\" (UID: \"1da5ddfa-1d35-46e1-80a4-11d20858e00f\") " pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:51.077378 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:51.077343 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vmk7q" Jul 16 00:48:51.202934 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:51.202859 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vmk7q"] Jul 16 00:48:51.205563 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:51.205537 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da5ddfa_1d35_46e1_80a4_11d20858e00f.slice/crio-5826a31a254900e9bb54484b94f97b116f00218056c86bf642aa8c764ba5191f WatchSource:0}: Error finding container 5826a31a254900e9bb54484b94f97b116f00218056c86bf642aa8c764ba5191f: Status 404 returned error can't find the container with id 5826a31a254900e9bb54484b94f97b116f00218056c86bf642aa8c764ba5191f Jul 16 00:48:51.877323 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:51.877284 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmk7q" event={"ID":"1da5ddfa-1d35-46e1-80a4-11d20858e00f","Type":"ContainerStarted","Data":"5826a31a254900e9bb54484b94f97b116f00218056c86bf642aa8c764ba5191f"} Jul 16 00:48:54.550668 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:54.550615 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" podUID="081b3ae8-51d3-47b8-8052-9756455f564f" Jul 16 00:48:54.550668 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:54.550622 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4qklq" podUID="d9e282ad-c750-4afe-8ae8-eec443f64bbe" Jul 16 00:48:54.551176 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:48:54.550624 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" Jul 16 00:48:54.886100 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:54.886070 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4qklq" Jul 16 00:48:54.886100 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:54.886091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:48:54.886347 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:54.886070 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:48:56.894609 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:56.894571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmk7q" event={"ID":"1da5ddfa-1d35-46e1-80a4-11d20858e00f","Type":"ContainerStarted","Data":"9df0d26ea388e7fe67f9595fbdcce15ef866dcbe7881457c797c8a0bbf2cfb60"} Jul 16 00:48:57.808671 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.808632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:48:57.811450 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.811423 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"image-registry-c669b5c8f-rrfhv\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:48:57.890300 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.890268 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pkjn\"" Jul 16 00:48:57.897547 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.897506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:48:57.909783 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.909758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:48:57.909893 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.909823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:48:57.912341 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.912320 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9e282ad-c750-4afe-8ae8-eec443f64bbe-metrics-tls\") pod \"dns-default-4qklq\" (UID: \"d9e282ad-c750-4afe-8ae8-eec443f64bbe\") " pod="openshift-dns/dns-default-4qklq" Jul 16 00:48:57.912850 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:57.912828 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/081b3ae8-51d3-47b8-8052-9756455f564f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-b9wzb\" (UID: \"081b3ae8-51d3-47b8-8052-9756455f564f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:48:58.190333 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:58.190302 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm4s9\"" Jul 16 00:48:58.190826 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:58.190784 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xbm2c\"" Jul 16 00:48:58.197783 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:58.197753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" Jul 16 00:48:58.197921 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:58.197797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4qklq" Jul 16 00:48:59.562159 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.562135 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4qklq"] Jul 16 00:48:59.565120 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:59.565095 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e282ad_c750_4afe_8ae8_eec443f64bbe.slice/crio-e3e0cc93ef66317eb5c7e87f543e320bf63a51e7e67bf421e1785be453d2d39d WatchSource:0}: Error finding container e3e0cc93ef66317eb5c7e87f543e320bf63a51e7e67bf421e1785be453d2d39d: Status 404 returned error can't find the container with id e3e0cc93ef66317eb5c7e87f543e320bf63a51e7e67bf421e1785be453d2d39d Jul 16 00:48:59.596862 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.596828 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c669b5c8f-rrfhv"] Jul 16 00:48:59.599296 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.599266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-b9wzb"] Jul 16 00:48:59.600575 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:59.600549 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ccbe94_0ced_4710_ac49_6de293a1d07a.slice/crio-56cdc639a87f03791a094ea10892f0f4d6ee2f8508cb38acc0b670f23c740438 WatchSource:0}: Error finding container 56cdc639a87f03791a094ea10892f0f4d6ee2f8508cb38acc0b670f23c740438: Status 404 returned error can't find the container with id 56cdc639a87f03791a094ea10892f0f4d6ee2f8508cb38acc0b670f23c740438 Jul 16 00:48:59.602296 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:48:59.602276 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081b3ae8_51d3_47b8_8052_9756455f564f.slice/crio-407dbd8aae8eac320e9380abc9cee2ba11fbeb8132a6e63e742e055920ad0076 WatchSource:0}: Error finding container 407dbd8aae8eac320e9380abc9cee2ba11fbeb8132a6e63e742e055920ad0076: Status 404 returned error can't find the container with id 407dbd8aae8eac320e9380abc9cee2ba11fbeb8132a6e63e742e055920ad0076 Jul 16 00:48:59.907407 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.907378 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmk7q" event={"ID":"1da5ddfa-1d35-46e1-80a4-11d20858e00f","Type":"ContainerStarted","Data":"309d9f9ae36de4de77ca5176b6f68f6dfe5ee5141e75f932a5077f31a727262b"} Jul 16 00:48:59.908599 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.908564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" event={"ID":"081b3ae8-51d3-47b8-8052-9756455f564f","Type":"ContainerStarted","Data":"407dbd8aae8eac320e9380abc9cee2ba11fbeb8132a6e63e742e055920ad0076"} Jul 16 00:48:59.909585 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.909556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4qklq" event={"ID":"d9e282ad-c750-4afe-8ae8-eec443f64bbe","Type":"ContainerStarted","Data":"e3e0cc93ef66317eb5c7e87f543e320bf63a51e7e67bf421e1785be453d2d39d"} Jul 16 00:48:59.910767 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.910744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" event={"ID":"20ccbe94-0ced-4710-ac49-6de293a1d07a","Type":"ContainerStarted","Data":"5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49"} Jul 16 00:48:59.910854 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.910786 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" event={"ID":"20ccbe94-0ced-4710-ac49-6de293a1d07a","Type":"ContainerStarted","Data":"56cdc639a87f03791a094ea10892f0f4d6ee2f8508cb38acc0b670f23c740438"} Jul 16 00:48:59.910917 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.910886 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:48:59.939125 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:48:59.939049 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" podStartSLOduration=287.93903426 podStartE2EDuration="4m47.93903426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:59.93754297 +0000 UTC m=+288.460614227" watchObservedRunningTime="2026-07-16 00:48:59.93903426 +0000 UTC m=+288.462105516" Jul 16 00:49:01.922207 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:01.922171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" event={"ID":"081b3ae8-51d3-47b8-8052-9756455f564f","Type":"ContainerStarted","Data":"9e1c9496e2dcda0dfe46fcdca3d75f1ce3c61d57abf2dd064e1453e1a2f5ffe4"} Jul 16 00:49:01.924169 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:01.924131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4qklq" event={"ID":"d9e282ad-c750-4afe-8ae8-eec443f64bbe","Type":"ContainerStarted","Data":"18ff18a1df92ccbf13ae385eb4e0d9b9ff45ec133fd026593edbfcd2c6bf3e9b"} Jul 16 00:49:01.924305 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:01.924174 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4qklq" event={"ID":"d9e282ad-c750-4afe-8ae8-eec443f64bbe","Type":"ContainerStarted","Data":"f5394f7d3e3c3b157e331e476044994ba99f554014d2ede0f9fbb28abd137f34"} Jul 16 00:49:01.924305 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:01.924260 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4qklq" Jul 16 00:49:01.964360 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:01.964305 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-b9wzb" podStartSLOduration=267.693121493 podStartE2EDuration="4m28.964285019s" totalImagesPullingTime="1.271163526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:01.941656035 +0000 UTC m=+290.464727290" watchObservedRunningTime="2026-07-16 00:49:01.964285019 +0000 UTC m=+290.487356277" Jul 16 00:49:01.964524 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:01.964407 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4qklq" podStartSLOduration=253.027166782 podStartE2EDuration="4m14.964400385s" totalImagesPullingTime="1.937233603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:01.963077682 +0000 UTC m=+290.486148942" watchObservedRunningTime="2026-07-16 00:49:01.964400385 +0000 UTC m=+290.487471641" Jul 16 00:49:02.045131 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:02.045090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:49:02.048144 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:02.048116 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ee9bc73-ab95-47cc-94ca-385dcf41b26c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9rnzl\" (UID: \"2ee9bc73-ab95-47cc-94ca-385dcf41b26c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:49:02.290620 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:02.290531 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" Jul 16 00:49:03.493285 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:03.493257 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl"] Jul 16 00:49:03.495627 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:03.495593 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee9bc73_ab95_47cc_94ca_385dcf41b26c.slice/crio-c46f45fd411ab3a95e3a31c4793766a51ad233d34e02e4eeb976dcc89695e2d2 WatchSource:0}: Error finding container c46f45fd411ab3a95e3a31c4793766a51ad233d34e02e4eeb976dcc89695e2d2: Status 404 returned error can't find the container with id c46f45fd411ab3a95e3a31c4793766a51ad233d34e02e4eeb976dcc89695e2d2 Jul 16 00:49:03.934233 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:03.934188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vmk7q" event={"ID":"1da5ddfa-1d35-46e1-80a4-11d20858e00f","Type":"ContainerStarted","Data":"9b1eba09639753b2e320e3270fca36b42c1bcdc3089f552cb6f4a95c3f8f2067"} Jul 16 00:49:03.935511 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:03.935483 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" event={"ID":"2ee9bc73-ab95-47cc-94ca-385dcf41b26c","Type":"ContainerStarted","Data":"c46f45fd411ab3a95e3a31c4793766a51ad233d34e02e4eeb976dcc89695e2d2"} Jul 16 00:49:03.958537 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:03.958487 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vmk7q" podStartSLOduration=16.907152903 podStartE2EDuration="28.958466273s" totalImagesPullingTime="12.05131337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:48:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:03.95778287 +0000 UTC m=+292.480854151" watchObservedRunningTime="2026-07-16 00:49:03.958466273 +0000 UTC m=+292.481537531" Jul 16 00:49:05.674791 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.674760 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc"] Jul 16 00:49:05.676906 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.676890 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:05.679106 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.679083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 00:49:05.679106 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.679098 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pfbx5\"" Jul 16 00:49:05.694635 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.694615 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc"] Jul 16 00:49:05.776763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.776723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c3916993-bdc8-4174-9155-1661a56147db-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vhtkc\" (UID: \"c3916993-bdc8-4174-9155-1661a56147db\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:05.877692 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.877658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c3916993-bdc8-4174-9155-1661a56147db-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vhtkc\" (UID: \"c3916993-bdc8-4174-9155-1661a56147db\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:05.880297 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.880278 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c3916993-bdc8-4174-9155-1661a56147db-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-vhtkc\" (UID: \"c3916993-bdc8-4174-9155-1661a56147db\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:05.944422 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.944325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" event={"ID":"2ee9bc73-ab95-47cc-94ca-385dcf41b26c","Type":"ContainerStarted","Data":"cab5bfdacc8cd87445bcd31aef8a8977888905b90f8b1724b75c766cab989b52"} Jul 16 00:49:05.967855 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.967804 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9rnzl" podStartSLOduration=34.26708881 podStartE2EDuration="35.967786474s" totalImagesPullingTime="1.700697664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:05.966528952 +0000 UTC m=+294.489600208" watchObservedRunningTime="2026-07-16 00:49:05.967786474 +0000 UTC m=+294.490857766" Jul 16 00:49:05.985438 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:05.985411 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:06.113971 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:06.113820 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc"] Jul 16 00:49:06.116531 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:06.116508 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3916993_bdc8_4174_9155_1661a56147db.slice/crio-85c62659a9e4ef148091ac7377568acfdc72ef32624778418cbb9ddebe5df6a4 WatchSource:0}: Error finding container 85c62659a9e4ef148091ac7377568acfdc72ef32624778418cbb9ddebe5df6a4: Status 404 returned error can't find the container with id 85c62659a9e4ef148091ac7377568acfdc72ef32624778418cbb9ddebe5df6a4 Jul 16 00:49:06.949571 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:06.949534 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" event={"ID":"c3916993-bdc8-4174-9155-1661a56147db","Type":"ContainerStarted","Data":"85c62659a9e4ef148091ac7377568acfdc72ef32624778418cbb9ddebe5df6a4"} Jul 16 00:49:06.967739 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:49:06.967701 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jrd68" podUID="58057755-9524-460e-975f-3e1aa107842f" Jul 16 00:49:07.954314 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:07.954279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" event={"ID":"c3916993-bdc8-4174-9155-1661a56147db","Type":"ContainerStarted","Data":"39c841bf7e920e6a3b57ec274bbd3fd7e73e62dd4511c2e5700c26c362d003eb"} Jul 16 00:49:07.954688 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:07.954462 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:07.958783 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:07.958762 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" Jul 16 00:49:07.973129 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:07.973083 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-vhtkc" podStartSLOduration=1.946246855 podStartE2EDuration="2.973070544s" totalImagesPullingTime="1.026823689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:07.971601526 +0000 UTC m=+296.494672798" watchObservedRunningTime="2026-07-16 00:49:07.973070544 +0000 UTC m=+296.496141798" Jul 16 00:49:11.843194 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:11.843169 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:49:11.843612 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:11.843315 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:49:11.846801 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:11.846772 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 00:49:11.930852 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:11.930823 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4qklq" Jul 16 00:49:13.119949 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.119916 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fp87d"] Jul 16 00:49:13.123116 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.123086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.125980 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.125962 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 00:49:13.126217 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.126198 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 00:49:13.126748 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.126707 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6mwtn\"" Jul 16 00:49:13.126922 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.126707 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 00:49:13.127186 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.127169 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 00:49:13.232707 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.232673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-wtmp\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.232863 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.232733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-textfile\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.232863 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.232800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-tls\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.232968 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.232882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.232968 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.232907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1263bb4-3619-47d8-be60-ee7d11dae8fa-metrics-client-ca\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.232968 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.232944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.233110 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.233002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8jrh\" (UniqueName: \"kubernetes.io/projected/b1263bb4-3619-47d8-be60-ee7d11dae8fa-kube-api-access-r8jrh\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.233110 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.233044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-root\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.233110 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.233080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-sys\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.333924 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.333885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-sys\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.333924 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.333930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-wtmp\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.333960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-textfile\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.333977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-tls\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334035 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-sys\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1263bb4-3619-47d8-be60-ee7d11dae8fa-metrics-client-ca\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334136 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-wtmp\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334213 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8jrh\" (UniqueName: \"kubernetes.io/projected/b1263bb4-3619-47d8-be60-ee7d11dae8fa-kube-api-access-r8jrh\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334584 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:49:13.334241 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 00:49:13.334584 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334288 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-root\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334584 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:49:13.334312 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-tls podName:b1263bb4-3619-47d8-be60-ee7d11dae8fa nodeName:}" failed. No retries permitted until 2026-07-16 00:49:13.834290065 +0000 UTC m=+302.357361298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-tls") pod "node-exporter-fp87d" (UID: "b1263bb4-3619-47d8-be60-ee7d11dae8fa") : secret "node-exporter-tls" not found Jul 16 00:49:13.334584 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b1263bb4-3619-47d8-be60-ee7d11dae8fa-root\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334584 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334404 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-textfile\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334742 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334648 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.334980 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.334964 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1263bb4-3619-47d8-be60-ee7d11dae8fa-metrics-client-ca\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.336675 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.336657 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.344838 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.344814 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8jrh\" (UniqueName: \"kubernetes.io/projected/b1263bb4-3619-47d8-be60-ee7d11dae8fa-kube-api-access-r8jrh\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.373539 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.373457 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bbcc9fcd7-f9zrs"] Jul 16 00:49:13.377696 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.377681 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.380101 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380074 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 00:49:13.380207 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380144 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 00:49:13.380207 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380156 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2sqss\"" Jul 16 00:49:13.380300 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380219 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 00:49:13.380456 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380439 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 00:49:13.380651 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380639 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 00:49:13.380861 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380847 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 00:49:13.380904 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.380870 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 00:49:13.386731 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.386711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 00:49:13.387122 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.387101 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbcc9fcd7-f9zrs"] Jul 16 00:49:13.536510 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-trusted-ca-bundle\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.536510 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-oauth-serving-cert\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.536743 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2dz\" (UniqueName: \"kubernetes.io/projected/548e9d03-97f5-4854-a9ee-a8a7061d47ea-kube-api-access-4p2dz\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.536743 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-serving-cert\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.536743 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-config\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.536895 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-service-ca\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.536895 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.536825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-oauth-config\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.637728 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.637639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-service-ca\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.637728 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.637698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-oauth-config\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.637728 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.637733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-trusted-ca-bundle\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638012 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.637755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-oauth-serving-cert\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638012 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.637779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2dz\" (UniqueName: \"kubernetes.io/projected/548e9d03-97f5-4854-a9ee-a8a7061d47ea-kube-api-access-4p2dz\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638012 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.637812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-serving-cert\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638172 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.638010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-config\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638480 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.638454 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-service-ca\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638746 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.638562 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-oauth-serving-cert\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.638746 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.638662 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-config\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.639035 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.639010 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-trusted-ca-bundle\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.640547 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.640522 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-oauth-config\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.640630 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.640528 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-serving-cert\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.650166 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.650144 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2dz\" (UniqueName: \"kubernetes.io/projected/548e9d03-97f5-4854-a9ee-a8a7061d47ea-kube-api-access-4p2dz\") pod \"console-6bbcc9fcd7-f9zrs\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.687804 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.687778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:13.819379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.819346 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbcc9fcd7-f9zrs"] Jul 16 00:49:13.822815 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:13.822791 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548e9d03_97f5_4854_a9ee_a8a7061d47ea.slice/crio-c0ad8cca4ecc0bded5de83e0db187ad303079344ed3c38ce7114c3ce97273275 WatchSource:0}: Error finding container c0ad8cca4ecc0bded5de83e0db187ad303079344ed3c38ce7114c3ce97273275: Status 404 returned error can't find the container with id c0ad8cca4ecc0bded5de83e0db187ad303079344ed3c38ce7114c3ce97273275 Jul 16 00:49:13.824867 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.824853 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:49:13.839633 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.839607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-tls\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.842145 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.842121 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1263bb4-3619-47d8-be60-ee7d11dae8fa-node-exporter-tls\") pod \"node-exporter-fp87d\" (UID: \"b1263bb4-3619-47d8-be60-ee7d11dae8fa\") " pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:13.980157 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:13.980067 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbcc9fcd7-f9zrs" event={"ID":"548e9d03-97f5-4854-a9ee-a8a7061d47ea","Type":"ContainerStarted","Data":"c0ad8cca4ecc0bded5de83e0db187ad303079344ed3c38ce7114c3ce97273275"} Jul 16 00:49:14.032954 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.032917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fp87d" Jul 16 00:49:14.045512 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:14.045483 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1263bb4_3619_47d8_be60_ee7d11dae8fa.slice/crio-a901033c594902e3fd84fce9b4cfef08ca2008ecf8be9f6cd8e842dd99ef4e36 WatchSource:0}: Error finding container a901033c594902e3fd84fce9b4cfef08ca2008ecf8be9f6cd8e842dd99ef4e36: Status 404 returned error can't find the container with id a901033c594902e3fd84fce9b4cfef08ca2008ecf8be9f6cd8e842dd99ef4e36 Jul 16 00:49:14.221982 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.221945 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 00:49:14.226621 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.226599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.230952 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.230880 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fz6j5\"" Jul 16 00:49:14.230952 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.230943 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 00:49:14.231134 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.230977 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 00:49:14.231398 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.231382 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 00:49:14.231485 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.231471 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 00:49:14.231587 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.231573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 00:49:14.231871 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.231850 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 00:49:14.232862 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.232849 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 00:49:14.232912 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.232878 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 00:49:14.235567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.235536 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 00:49:14.253521 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.253498 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 00:49:14.344041 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344010 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344222 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344222 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344222 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-config-out\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-web-config\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344633 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344633 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344633 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.344633 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.344500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56t2r\" (UniqueName: \"kubernetes.io/projected/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-kube-api-access-56t2r\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445519 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-web-config\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445638 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56t2r\" (UniqueName: \"kubernetes.io/projected/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-kube-api-access-56t2r\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.445694 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.446077 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.446077 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.446077 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.446077 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-config-out\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.446077 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.445899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.447161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.446822 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.447161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.447012 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.447161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.447032 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.448691 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.448649 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.449969 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.449938 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.451230 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.450772 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-web-config\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.451230 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.450843 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.451230 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.451183 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.451423 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.451265 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.451423 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.451304 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.452064 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.452043 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-config-out\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.452541 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.452496 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.457182 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.457127 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56t2r\" (UniqueName: \"kubernetes.io/projected/d278c0be-7f0f-40f0-92f5-5f4a057a61e5-kube-api-access-56t2r\") pod \"alertmanager-main-0\" (UID: \"d278c0be-7f0f-40f0-92f5-5f4a057a61e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.537603 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.537522 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 00:49:14.720494 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.720454 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 00:49:14.724361 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:14.724333 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd278c0be_7f0f_40f0_92f5_5f4a057a61e5.slice/crio-dd81b4c6ad4a2bea4b8ae6b248e97e3b7b802027b3b5b12ffb6f5b4548df67a3 WatchSource:0}: Error finding container dd81b4c6ad4a2bea4b8ae6b248e97e3b7b802027b3b5b12ffb6f5b4548df67a3: Status 404 returned error can't find the container with id dd81b4c6ad4a2bea4b8ae6b248e97e3b7b802027b3b5b12ffb6f5b4548df67a3 Jul 16 00:49:14.987133 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.987091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"dd81b4c6ad4a2bea4b8ae6b248e97e3b7b802027b3b5b12ffb6f5b4548df67a3"} Jul 16 00:49:14.988819 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:14.988758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fp87d" event={"ID":"b1263bb4-3619-47d8-be60-ee7d11dae8fa","Type":"ContainerStarted","Data":"a901033c594902e3fd84fce9b4cfef08ca2008ecf8be9f6cd8e842dd99ef4e36"} Jul 16 00:49:15.994712 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:15.994674 2567 generic.go:356] "Generic (PLEG): container finished" podID="b1263bb4-3619-47d8-be60-ee7d11dae8fa" containerID="8804714c20e64fd7cb53f33f1568133943c770ed4d9523a73ae4eb16d97ce921" exitCode=0 Jul 16 00:49:15.995219 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:15.994761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fp87d" event={"ID":"b1263bb4-3619-47d8-be60-ee7d11dae8fa","Type":"ContainerDied","Data":"8804714c20e64fd7cb53f33f1568133943c770ed4d9523a73ae4eb16d97ce921"} Jul 16 00:49:17.001668 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.001623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fp87d" event={"ID":"b1263bb4-3619-47d8-be60-ee7d11dae8fa","Type":"ContainerStarted","Data":"9b27c7e79b3090ecd7802464d8191208aaac5bddc32d2fffa6858e5f6cb9595a"} Jul 16 00:49:17.002153 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.001706 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fp87d" event={"ID":"b1263bb4-3619-47d8-be60-ee7d11dae8fa","Type":"ContainerStarted","Data":"190ffea4eb115a3295d8f77cfd8e7925b28560b92425a94c50a3bf9d91e0023d"} Jul 16 00:49:17.003397 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.003371 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbcc9fcd7-f9zrs" event={"ID":"548e9d03-97f5-4854-a9ee-a8a7061d47ea","Type":"ContainerStarted","Data":"b3e21504398adfc30ea4bda06d31e23ec993e2b769a3af096c4cccef064d539d"} Jul 16 00:49:17.004778 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.004756 2567 generic.go:356] "Generic (PLEG): container finished" podID="d278c0be-7f0f-40f0-92f5-5f4a057a61e5" containerID="f5a2cf6194d5a541e3ed1b452d19714c4f7605069889aa2d1abe416a01f6f744" exitCode=0 Jul 16 00:49:17.004876 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.004793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerDied","Data":"f5a2cf6194d5a541e3ed1b452d19714c4f7605069889aa2d1abe416a01f6f744"} Jul 16 00:49:17.032893 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.032842 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fp87d" podStartSLOduration=2.9149164560000003 podStartE2EDuration="4.032826194s" totalImagesPullingTime="1.026711239s" totalInitContainerRuntime="91.198499ms" isStatefulPod=true podCreationTimestamp="2026-07-16 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:17.031251602 +0000 UTC m=+305.554322857" watchObservedRunningTime="2026-07-16 00:49:17.032826194 +0000 UTC m=+305.555897448" Jul 16 00:49:17.113841 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.113788 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bbcc9fcd7-f9zrs" podStartSLOduration=1.075224166 podStartE2EDuration="4.11377263s" totalImagesPullingTime="3.038548464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:17.112594529 +0000 UTC m=+305.635665784" watchObservedRunningTime="2026-07-16 00:49:17.11377263 +0000 UTC m=+305.636843886" Jul 16 00:49:17.525536 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.525453 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-675bb5bfd8-tjdgn"] Jul 16 00:49:17.528665 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.528640 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.531106 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.531082 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4dbkf3lg6m16r\"" Jul 16 00:49:17.531219 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.531082 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 00:49:17.531219 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.531082 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jlxhz\"" Jul 16 00:49:17.531327 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.531229 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 00:49:17.531507 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.531490 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 00:49:17.531603 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.531582 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 00:49:17.541068 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.541046 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-675bb5bfd8-tjdgn"] Jul 16 00:49:17.679983 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.679947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ds4w\" (UniqueName: \"kubernetes.io/projected/5c54cb63-5976-4b60-ada2-18a0bd6e555d-kube-api-access-9ds4w\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.680182 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.680111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c54cb63-5976-4b60-ada2-18a0bd6e555d-metrics-server-audit-profiles\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.680182 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.680165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c54cb63-5976-4b60-ada2-18a0bd6e555d-audit-log\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.680277 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.680221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-client-ca-bundle\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.680329 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.680275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c54cb63-5976-4b60-ada2-18a0bd6e555d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.680329 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.680317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-secret-metrics-server-tls\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.680418 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.680353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-secret-metrics-server-client-certs\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.780973 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.780893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-client-ca-bundle\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.780973 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.780939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c54cb63-5976-4b60-ada2-18a0bd6e555d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.780973 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.780968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-secret-metrics-server-tls\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.781271 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.781106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-secret-metrics-server-client-certs\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.781271 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.781155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ds4w\" (UniqueName: \"kubernetes.io/projected/5c54cb63-5976-4b60-ada2-18a0bd6e555d-kube-api-access-9ds4w\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.781271 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.781220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c54cb63-5976-4b60-ada2-18a0bd6e555d-metrics-server-audit-profiles\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.781271 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.781264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c54cb63-5976-4b60-ada2-18a0bd6e555d-audit-log\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.781779 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.781673 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5c54cb63-5976-4b60-ada2-18a0bd6e555d-audit-log\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.781887 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.781844 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c54cb63-5976-4b60-ada2-18a0bd6e555d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.782305 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.782281 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5c54cb63-5976-4b60-ada2-18a0bd6e555d-metrics-server-audit-profiles\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.784225 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.784202 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-client-ca-bundle\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.784323 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.784202 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-secret-metrics-server-tls\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.784323 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.784245 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5c54cb63-5976-4b60-ada2-18a0bd6e555d-secret-metrics-server-client-certs\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.790688 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.790667 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ds4w\" (UniqueName: \"kubernetes.io/projected/5c54cb63-5976-4b60-ada2-18a0bd6e555d-kube-api-access-9ds4w\") pod \"metrics-server-675bb5bfd8-tjdgn\" (UID: \"5c54cb63-5976-4b60-ada2-18a0bd6e555d\") " pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.840628 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.840598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:17.907902 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.907841 2567 patch_prober.go:28] interesting pod/image-registry-c669b5c8f-rrfhv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 00:49:17.908055 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.907901 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:49:17.966938 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.966563 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:49:17.998251 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:17.998218 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-675bb5bfd8-tjdgn"] Jul 16 00:49:18.337048 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:18.337013 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c54cb63_5976_4b60_ada2_18a0bd6e555d.slice/crio-e3f801b38fbf2bad26fc2a5633d27fa6635a887ee9ddc27137ca4248884ef1e6 WatchSource:0}: Error finding container e3f801b38fbf2bad26fc2a5633d27fa6635a887ee9ddc27137ca4248884ef1e6: Status 404 returned error can't find the container with id e3f801b38fbf2bad26fc2a5633d27fa6635a887ee9ddc27137ca4248884ef1e6 Jul 16 00:49:18.339650 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:18.339625 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c669b5c8f-rrfhv"] Jul 16 00:49:18.344518 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:18.344489 2567 patch_prober.go:28] interesting pod/image-registry-c669b5c8f-rrfhv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 00:49:18.344614 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:18.344540 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:49:19.018013 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.017957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" event={"ID":"5c54cb63-5976-4b60-ada2-18a0bd6e555d","Type":"ContainerStarted","Data":"e3f801b38fbf2bad26fc2a5633d27fa6635a887ee9ddc27137ca4248884ef1e6"} Jul 16 00:49:19.021827 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.021763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"c038aa3d83b59face42800b2b319cebf0d581adce8de7d4003a3ae12699b1455"} Jul 16 00:49:19.022019 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.021843 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"ccae44a7b6f00db7f668421b5878e1bfb093d259bfdf587ba13f2e913eee6c29"} Jul 16 00:49:19.022019 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.021883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"414d1e355f8e80309663b4134ba22d218a78034c8db517ea6a873dcedfa385f5"} Jul 16 00:49:19.022019 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.021918 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"ca9a399ab23405e0f6adcc1858d6e1ad953b8fedf6c5f7bec44c6a2f85c9b940"} Jul 16 00:49:19.022161 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.022031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"39b360e0e159501a51728bf921cb4da855541a48d9c2f8c755beef4de6cbd42f"} Jul 16 00:49:19.381092 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.381055 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 00:49:19.385165 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.385135 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.388103 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388063 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 00:49:19.388227 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388147 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 00:49:19.388625 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388512 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 00:49:19.388625 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388552 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 00:49:19.388808 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 00:49:19.388892 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388874 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 00:49:19.389088 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388878 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 00:49:19.389088 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388964 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 00:49:19.389088 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388971 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 00:49:19.389088 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.388965 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 00:49:19.389738 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.389678 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 00:49:19.390604 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.389853 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ggrvb\"" Jul 16 00:49:19.390604 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.389864 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 00:49:19.390604 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.389885 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 00:49:19.390604 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.390313 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1chb40haajm2b\"" Jul 16 00:49:19.395651 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.394947 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 00:49:19.409774 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.409740 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 00:49:19.497482 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-config\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497661 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497661 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497661 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497566 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08244e1b-d8ec-47e1-b645-cb056f89b5bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497661 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497661 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497661 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497951 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497951 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497951 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497951 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497951 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.497951 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497889 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdrjg\" (UniqueName: \"kubernetes.io/projected/08244e1b-d8ec-47e1-b645-cb056f89b5bb-kube-api-access-rdrjg\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.497983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.498054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.498118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.498152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08244e1b-d8ec-47e1-b645-cb056f89b5bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.498175 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.498218 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.498193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599286 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599493 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599493 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599493 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599361 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599493 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599387 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08244e1b-d8ec-47e1-b645-cb056f89b5bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599686 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599686 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599686 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-config\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599824 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599824 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599824 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599778 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08244e1b-d8ec-47e1-b645-cb056f89b5bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.599824 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.599980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600038 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdrjg\" (UniqueName: \"kubernetes.io/projected/08244e1b-d8ec-47e1-b645-cb056f89b5bb-kube-api-access-rdrjg\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600137 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600176 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600176 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.600561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600536 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.601133 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.600923 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.601832 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.601803 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.604488 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.604179 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08244e1b-d8ec-47e1-b645-cb056f89b5bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.604488 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.604335 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.604488 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.604450 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08244e1b-d8ec-47e1-b645-cb056f89b5bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.604697 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.604674 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.604762 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.604698 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.605533 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.605470 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.605631 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.605532 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.606014 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.605952 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.606014 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.605979 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.607576 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.606439 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.607576 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.606651 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08244e1b-d8ec-47e1-b645-cb056f89b5bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.607576 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.607199 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-config\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.607705 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.607601 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08244e1b-d8ec-47e1-b645-cb056f89b5bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.608883 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.608861 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdrjg\" (UniqueName: \"kubernetes.io/projected/08244e1b-d8ec-47e1-b645-cb056f89b5bb-kube-api-access-rdrjg\") pod \"prometheus-k8s-0\" (UID: \"08244e1b-d8ec-47e1-b645-cb056f89b5bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.700625 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.700534 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:19.932138 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.932115 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 00:49:19.934696 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:49:19.934666 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08244e1b_d8ec_47e1_b645_cb056f89b5bb.slice/crio-662e0f203b0c9132eb319013fa4b660c826ffd922ff12d7ba2e6797e47e53b58 WatchSource:0}: Error finding container 662e0f203b0c9132eb319013fa4b660c826ffd922ff12d7ba2e6797e47e53b58: Status 404 returned error can't find the container with id 662e0f203b0c9132eb319013fa4b660c826ffd922ff12d7ba2e6797e47e53b58 Jul 16 00:49:19.987110 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:19.987086 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bbcc9fcd7-f9zrs"] Jul 16 00:49:20.029385 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:20.029347 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" event={"ID":"5c54cb63-5976-4b60-ada2-18a0bd6e555d","Type":"ContainerStarted","Data":"5420bf0452e8dc83274e9ab94bfe5c3d5c48bca835a98825439ff2ff96070262"} Jul 16 00:49:20.034633 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:20.034598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d278c0be-7f0f-40f0-92f5-5f4a057a61e5","Type":"ContainerStarted","Data":"5ace40e81c12e63b8c97a31b8af4a0f74ca4937d273795f987f005136107f054"} Jul 16 00:49:20.036733 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:20.036705 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"1b6e91048e514098a8c3ef0bad19a12a9ea87bc467b182c0898d30ef2b3f162d"} Jul 16 00:49:20.036850 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:20.036778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"662e0f203b0c9132eb319013fa4b660c826ffd922ff12d7ba2e6797e47e53b58"} Jul 16 00:49:20.050480 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:20.050424 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" podStartSLOduration=1.6007310289999999 podStartE2EDuration="3.050409294s" totalImagesPullingTime="1.449678265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:20.049556338 +0000 UTC m=+308.572627594" watchObservedRunningTime="2026-07-16 00:49:20.050409294 +0000 UTC m=+308.573480549" Jul 16 00:49:20.080019 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:20.079954 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.503528902 podStartE2EDuration="6.079938536s" totalImagesPullingTime="4.560565549s" totalInitContainerRuntime="15.844085ms" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:20.078886798 +0000 UTC m=+308.601958054" watchObservedRunningTime="2026-07-16 00:49:20.079938536 +0000 UTC m=+308.603009791" Jul 16 00:49:21.042032 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:21.041961 2567 generic.go:356] "Generic (PLEG): container finished" podID="08244e1b-d8ec-47e1-b645-cb056f89b5bb" containerID="1b6e91048e514098a8c3ef0bad19a12a9ea87bc467b182c0898d30ef2b3f162d" exitCode=0 Jul 16 00:49:21.042399 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:21.042055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerDied","Data":"1b6e91048e514098a8c3ef0bad19a12a9ea87bc467b182c0898d30ef2b3f162d"} Jul 16 00:49:23.688293 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:23.688255 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:24.058489 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:24.058458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"286d60ba4a7c813dd11ecbc33071367c74b097d3cdb0ff653b2c9b5c0eae3f3c"} Jul 16 00:49:25.065642 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:25.065602 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"d9da8264d49a39e2e309b5c41b3cf907eb240fa3f41a7c719def4565c337e684"} Jul 16 00:49:26.073503 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:26.073404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"1621cba720917d0aa644b89c6c11f138ac286a4296dcca6e8bedaf52871073e8"} Jul 16 00:49:26.073503 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:26.073491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"dcde636c978ea594802f7e3f911914f18b33d320f00b6960abb5ae6026151ba8"} Jul 16 00:49:26.074017 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:26.073523 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"f834d41964a37feaf3a05e58dae29c1d2c4f78679f9eb3cbb271913da6fb88a1"} Jul 16 00:49:26.074017 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:26.073552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08244e1b-d8ec-47e1-b645-cb056f89b5bb","Type":"ContainerStarted","Data":"87a732bcc68259eb98e3fe234936a09dbbff086359dddc812760e08ba3ae1492"} Jul 16 00:49:26.106677 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:26.106616 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.465019642 podStartE2EDuration="7.106594399s" totalImagesPullingTime="4.621620529s" totalInitContainerRuntime="19.954228ms" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:26.104133259 +0000 UTC m=+314.627204554" watchObservedRunningTime="2026-07-16 00:49:26.106594399 +0000 UTC m=+314.629665655" Jul 16 00:49:28.344411 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:28.344383 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:49:29.701398 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:29.701352 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:49:37.841383 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:37.841352 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:37.841860 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:37.841410 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:43.360889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.360817 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerName="registry" containerID="cri-o://5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49" gracePeriod=30 Jul 16 00:49:43.613658 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.613605 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:49:43.726862 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.726822 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-bound-sa-token\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.726882 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-image-registry-private-configuration\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.726918 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.726943 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20ccbe94-0ced-4710-ac49-6de293a1d07a-ca-trust-extracted\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.726963 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5xdk\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-kube-api-access-v5xdk\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.727016 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-installation-pull-secrets\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.727043 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-certificates\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.727078 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-trusted-ca\") pod \"20ccbe94-0ced-4710-ac49-6de293a1d07a\" (UID: \"20ccbe94-0ced-4710-ac49-6de293a1d07a\") " Jul 16 00:49:43.727800 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.727708 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:43.727800 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.727714 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:43.729763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.729607 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:43.729763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.729633 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:49:43.729763 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.729688 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:43.729984 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.729900 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-kube-api-access-v5xdk" (OuterVolumeSpecName: "kube-api-access-v5xdk") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "kube-api-access-v5xdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:43.730205 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.730180 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:49:43.735798 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.735773 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ccbe94-0ced-4710-ac49-6de293a1d07a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "20ccbe94-0ced-4710-ac49-6de293a1d07a" (UID: "20ccbe94-0ced-4710-ac49-6de293a1d07a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:43.828084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828033 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-installation-pull-secrets\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828076 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-certificates\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828088 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ccbe94-0ced-4710-ac49-6de293a1d07a-trusted-ca\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828097 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-bound-sa-token\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828356 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828107 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20ccbe94-0ced-4710-ac49-6de293a1d07a-image-registry-private-configuration\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828356 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828116 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-registry-tls\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828356 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828124 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20ccbe94-0ced-4710-ac49-6de293a1d07a-ca-trust-extracted\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:43.828356 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:43.828131 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5xdk\" (UniqueName: \"kubernetes.io/projected/20ccbe94-0ced-4710-ac49-6de293a1d07a-kube-api-access-v5xdk\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:44.147894 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.147861 2567 generic.go:356] "Generic (PLEG): container finished" podID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerID="5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49" exitCode=0 Jul 16 00:49:44.148076 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.147913 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" Jul 16 00:49:44.148076 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.147953 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" event={"ID":"20ccbe94-0ced-4710-ac49-6de293a1d07a","Type":"ContainerDied","Data":"5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49"} Jul 16 00:49:44.148076 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.148020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c669b5c8f-rrfhv" event={"ID":"20ccbe94-0ced-4710-ac49-6de293a1d07a","Type":"ContainerDied","Data":"56cdc639a87f03791a094ea10892f0f4d6ee2f8508cb38acc0b670f23c740438"} Jul 16 00:49:44.148076 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.148047 2567 scope.go:117] "RemoveContainer" containerID="5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49" Jul 16 00:49:44.156623 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.156602 2567 scope.go:117] "RemoveContainer" containerID="5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49" Jul 16 00:49:44.156893 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:49:44.156871 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49\": container with ID starting with 5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49 not found: ID does not exist" containerID="5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49" Jul 16 00:49:44.156977 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.156906 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49"} err="failed to get container status \"5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49\": rpc error: code = NotFound desc = could not find container \"5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49\": container with ID starting with 5c03b55cdcf65d1d796a4df902e5d518076e6b54ac6be7d8ee028cc93fa38c49 not found: ID does not exist" Jul 16 00:49:44.165623 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.165598 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c669b5c8f-rrfhv"] Jul 16 00:49:44.169377 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:44.169356 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c669b5c8f-rrfhv"] Jul 16 00:49:45.008051 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.007981 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bbcc9fcd7-f9zrs" podUID="548e9d03-97f5-4854-a9ee-a8a7061d47ea" containerName="console" containerID="cri-o://b3e21504398adfc30ea4bda06d31e23ec993e2b769a3af096c4cccef064d539d" gracePeriod=15 Jul 16 00:49:45.155212 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.155178 2567 generic.go:356] "Generic (PLEG): container finished" podID="548e9d03-97f5-4854-a9ee-a8a7061d47ea" containerID="b3e21504398adfc30ea4bda06d31e23ec993e2b769a3af096c4cccef064d539d" exitCode=0 Jul 16 00:49:45.155370 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.155248 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbcc9fcd7-f9zrs" event={"ID":"548e9d03-97f5-4854-a9ee-a8a7061d47ea","Type":"ContainerDied","Data":"b3e21504398adfc30ea4bda06d31e23ec993e2b769a3af096c4cccef064d539d"} Jul 16 00:49:45.261230 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.261164 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:45.341514 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341470 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-serving-cert\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.341717 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341540 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-service-ca\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.341717 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341566 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-oauth-config\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.341717 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341646 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p2dz\" (UniqueName: \"kubernetes.io/projected/548e9d03-97f5-4854-a9ee-a8a7061d47ea-kube-api-access-4p2dz\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.341717 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341677 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-trusted-ca-bundle\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.341717 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341700 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-oauth-serving-cert\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.341953 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.341738 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-config\") pod \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\" (UID: \"548e9d03-97f5-4854-a9ee-a8a7061d47ea\") " Jul 16 00:49:45.342082 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.342042 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:45.342241 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.342143 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:45.342354 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.342220 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:45.342424 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.342305 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-config" (OuterVolumeSpecName: "console-config") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:45.343974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.343953 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:49:45.344056 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.343972 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548e9d03-97f5-4854-a9ee-a8a7061d47ea-kube-api-access-4p2dz" (OuterVolumeSpecName: "kube-api-access-4p2dz") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "kube-api-access-4p2dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:45.344056 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.344022 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "548e9d03-97f5-4854-a9ee-a8a7061d47ea" (UID: "548e9d03-97f5-4854-a9ee-a8a7061d47ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:49:45.442749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442716 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p2dz\" (UniqueName: \"kubernetes.io/projected/548e9d03-97f5-4854-a9ee-a8a7061d47ea-kube-api-access-4p2dz\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.442749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442743 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-trusted-ca-bundle\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.442749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442752 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-oauth-serving-cert\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.442972 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442761 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-config\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.442972 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442770 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-serving-cert\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.442972 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442779 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/548e9d03-97f5-4854-a9ee-a8a7061d47ea-service-ca\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.442972 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.442787 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/548e9d03-97f5-4854-a9ee-a8a7061d47ea-console-oauth-config\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:49:45.970725 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:45.970690 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" path="/var/lib/kubelet/pods/20ccbe94-0ced-4710-ac49-6de293a1d07a/volumes" Jul 16 00:49:46.165801 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:46.165765 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbcc9fcd7-f9zrs" Jul 16 00:49:46.166222 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:46.165766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbcc9fcd7-f9zrs" event={"ID":"548e9d03-97f5-4854-a9ee-a8a7061d47ea","Type":"ContainerDied","Data":"c0ad8cca4ecc0bded5de83e0db187ad303079344ed3c38ce7114c3ce97273275"} Jul 16 00:49:46.166222 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:46.165931 2567 scope.go:117] "RemoveContainer" containerID="b3e21504398adfc30ea4bda06d31e23ec993e2b769a3af096c4cccef064d539d" Jul 16 00:49:46.183634 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:46.183606 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bbcc9fcd7-f9zrs"] Jul 16 00:49:46.187109 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:46.187088 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bbcc9fcd7-f9zrs"] Jul 16 00:49:47.971519 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:47.971480 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="548e9d03-97f5-4854-a9ee-a8a7061d47ea" path="/var/lib/kubelet/pods/548e9d03-97f5-4854-a9ee-a8a7061d47ea/volumes" Jul 16 00:49:49.180548 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:49.180511 2567 generic.go:356] "Generic (PLEG): container finished" podID="4cf09d64-b3a0-4ef6-82f2-801119318d43" containerID="154f6ed9d07ab530853bc0d88e511c5e600626775866e40c7f05e6cebca6d3bb" exitCode=0 Jul 16 00:49:49.180959 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:49.180559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" event={"ID":"4cf09d64-b3a0-4ef6-82f2-801119318d43","Type":"ContainerDied","Data":"154f6ed9d07ab530853bc0d88e511c5e600626775866e40c7f05e6cebca6d3bb"} Jul 16 00:49:49.180959 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:49.180875 2567 scope.go:117] "RemoveContainer" containerID="154f6ed9d07ab530853bc0d88e511c5e600626775866e40c7f05e6cebca6d3bb" Jul 16 00:49:50.185791 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:50.185761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-4rhzd" event={"ID":"4cf09d64-b3a0-4ef6-82f2-801119318d43","Type":"ContainerStarted","Data":"2a5fbaf70e8b926f0d52a83e2d6e45ce3c9b8d18a3a8418a85162f3e33b72d1a"} Jul 16 00:49:57.846964 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:57.846930 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:49:57.851135 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:49:57.851112 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-675bb5bfd8-tjdgn" Jul 16 00:50:19.700689 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:19.700651 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:50:19.721214 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:19.721185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:50:20.320142 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:20.320114 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 00:50:24.878190 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:24.878145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:50:24.880545 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:24.880522 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58057755-9524-460e-975f-3e1aa107842f-metrics-certs\") pod \"network-metrics-daemon-jrd68\" (UID: \"58057755-9524-460e-975f-3e1aa107842f\") " pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:50:25.170823 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:25.170732 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b92gb\"" Jul 16 00:50:25.177919 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:25.177900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jrd68" Jul 16 00:50:25.310317 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:25.310293 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jrd68"] Jul 16 00:50:25.313195 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:50:25.313165 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58057755_9524_460e_975f_3e1aa107842f.slice/crio-b581a5c7fd745e2f0c802fd18e1052daea7ddf2c2fbf6e70a49f7e4881b1e564 WatchSource:0}: Error finding container b581a5c7fd745e2f0c802fd18e1052daea7ddf2c2fbf6e70a49f7e4881b1e564: Status 404 returned error can't find the container with id b581a5c7fd745e2f0c802fd18e1052daea7ddf2c2fbf6e70a49f7e4881b1e564 Jul 16 00:50:25.323471 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:25.323443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jrd68" event={"ID":"58057755-9524-460e-975f-3e1aa107842f","Type":"ContainerStarted","Data":"b581a5c7fd745e2f0c802fd18e1052daea7ddf2c2fbf6e70a49f7e4881b1e564"} Jul 16 00:50:27.332491 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:27.332455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jrd68" event={"ID":"58057755-9524-460e-975f-3e1aa107842f","Type":"ContainerStarted","Data":"74258598c3c43ec27aaed0f2abd773c771d7ebcafedc9cda89c0efd4cbe485fb"} Jul 16 00:50:27.332866 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:27.332540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jrd68" event={"ID":"58057755-9524-460e-975f-3e1aa107842f","Type":"ContainerStarted","Data":"d96da63eee2c72ec7759217293d922a1683a4ea9cc591a19317fb517871abc65"} Jul 16 00:50:27.352885 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:50:27.352839 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jrd68" podStartSLOduration=374.307047142 podStartE2EDuration="6m15.352824371s" totalImagesPullingTime="1.045777229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:27.351709474 +0000 UTC m=+375.874780728" watchObservedRunningTime="2026-07-16 00:50:27.352824371 +0000 UTC m=+375.875895625" Jul 16 00:52:06.806646 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.806613 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sdld8"] Jul 16 00:52:06.807108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.806892 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548e9d03-97f5-4854-a9ee-a8a7061d47ea" containerName="console" Jul 16 00:52:06.807108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.806903 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="548e9d03-97f5-4854-a9ee-a8a7061d47ea" containerName="console" Jul 16 00:52:06.807108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.806941 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerName="registry" Jul 16 00:52:06.807108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.806947 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerName="registry" Jul 16 00:52:06.807108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.807035 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ccbe94-0ced-4710-ac49-6de293a1d07a" containerName="registry" Jul 16 00:52:06.807108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.807049 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="548e9d03-97f5-4854-a9ee-a8a7061d47ea" containerName="console" Jul 16 00:52:06.809933 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.809914 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:06.812842 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.812819 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 00:52:06.812947 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.812865 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nwgpc\"" Jul 16 00:52:06.813639 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.813624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 00:52:06.819255 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.819232 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sdld8"] Jul 16 00:52:06.836961 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.836931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4rp\" (UniqueName: \"kubernetes.io/projected/e6832fe7-ec1a-4e6f-8225-395e33a19aff-kube-api-access-bn4rp\") pod \"cert-manager-55b4d954d5-sdld8\" (UID: \"e6832fe7-ec1a-4e6f-8225-395e33a19aff\") " pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:06.837086 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.837034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6832fe7-ec1a-4e6f-8225-395e33a19aff-bound-sa-token\") pod \"cert-manager-55b4d954d5-sdld8\" (UID: \"e6832fe7-ec1a-4e6f-8225-395e33a19aff\") " pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:06.938347 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.938308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6832fe7-ec1a-4e6f-8225-395e33a19aff-bound-sa-token\") pod \"cert-manager-55b4d954d5-sdld8\" (UID: \"e6832fe7-ec1a-4e6f-8225-395e33a19aff\") " pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:06.938484 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.938358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4rp\" (UniqueName: \"kubernetes.io/projected/e6832fe7-ec1a-4e6f-8225-395e33a19aff-kube-api-access-bn4rp\") pod \"cert-manager-55b4d954d5-sdld8\" (UID: \"e6832fe7-ec1a-4e6f-8225-395e33a19aff\") " pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:06.947483 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.947449 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6832fe7-ec1a-4e6f-8225-395e33a19aff-bound-sa-token\") pod \"cert-manager-55b4d954d5-sdld8\" (UID: \"e6832fe7-ec1a-4e6f-8225-395e33a19aff\") " pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:06.947583 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:06.947553 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4rp\" (UniqueName: \"kubernetes.io/projected/e6832fe7-ec1a-4e6f-8225-395e33a19aff-kube-api-access-bn4rp\") pod \"cert-manager-55b4d954d5-sdld8\" (UID: \"e6832fe7-ec1a-4e6f-8225-395e33a19aff\") " pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:07.133930 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:07.133873 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sdld8" Jul 16 00:52:07.263690 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:07.263654 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sdld8"] Jul 16 00:52:07.266966 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:52:07.266940 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6832fe7_ec1a_4e6f_8225_395e33a19aff.slice/crio-3078087da891cda5151c46eee7a47ad74f0f022cd834c4781be44a169e12f911 WatchSource:0}: Error finding container 3078087da891cda5151c46eee7a47ad74f0f022cd834c4781be44a169e12f911: Status 404 returned error can't find the container with id 3078087da891cda5151c46eee7a47ad74f0f022cd834c4781be44a169e12f911 Jul 16 00:52:07.711719 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:07.711678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sdld8" event={"ID":"e6832fe7-ec1a-4e6f-8225-395e33a19aff","Type":"ContainerStarted","Data":"3078087da891cda5151c46eee7a47ad74f0f022cd834c4781be44a169e12f911"} Jul 16 00:52:10.726802 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:10.726764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sdld8" event={"ID":"e6832fe7-ec1a-4e6f-8225-395e33a19aff","Type":"ContainerStarted","Data":"5b84f994e396316de26bb5785ade6009bf92c6b65ae03593749d5c9feee52454"} Jul 16 00:52:10.745156 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:10.745113 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-sdld8" podStartSLOduration=1.9036504060000001 podStartE2EDuration="4.745099627s" totalImagesPullingTime="2.841449221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:10.744856149 +0000 UTC m=+479.267927417" watchObservedRunningTime="2026-07-16 00:52:10.745099627 +0000 UTC m=+479.268170881" Jul 16 00:52:36.940380 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.940341 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj"] Jul 16 00:52:36.943727 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.943710 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:36.946917 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.946897 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 00:52:36.947914 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.947884 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:52:36.948044 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.947931 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 00:52:36.948044 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.947937 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-grd8c\"" Jul 16 00:52:36.948044 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.947939 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 00:52:36.950966 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.950949 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 00:52:36.958264 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:36.958243 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj"] Jul 16 00:52:37.094660 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.094627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d99340a-8592-4ea8-8669-71356f98347a-manager-config\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.094832 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.094690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d99340a-8592-4ea8-8669-71356f98347a-metrics-cert\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.094832 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.094708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d99340a-8592-4ea8-8669-71356f98347a-cert\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.094832 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.094732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqn7w\" (UniqueName: \"kubernetes.io/projected/8d99340a-8592-4ea8-8669-71356f98347a-kube-api-access-wqn7w\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.196036 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.195919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d99340a-8592-4ea8-8669-71356f98347a-cert\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.196036 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.195959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqn7w\" (UniqueName: \"kubernetes.io/projected/8d99340a-8592-4ea8-8669-71356f98347a-kube-api-access-wqn7w\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.196036 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.196017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d99340a-8592-4ea8-8669-71356f98347a-manager-config\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.196341 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.196061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d99340a-8592-4ea8-8669-71356f98347a-metrics-cert\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.196719 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.196694 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d99340a-8592-4ea8-8669-71356f98347a-manager-config\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.198640 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.198618 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d99340a-8592-4ea8-8669-71356f98347a-metrics-cert\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.198749 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.198660 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d99340a-8592-4ea8-8669-71356f98347a-cert\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.205178 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.205153 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqn7w\" (UniqueName: \"kubernetes.io/projected/8d99340a-8592-4ea8-8669-71356f98347a-kube-api-access-wqn7w\") pod \"lws-controller-manager-57c869f4fd-mktwj\" (UID: \"8d99340a-8592-4ea8-8669-71356f98347a\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.252957 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.252931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:37.410797 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.410774 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj"] Jul 16 00:52:37.413302 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:52:37.413276 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d99340a_8592_4ea8_8669_71356f98347a.slice/crio-67295d1e7a98251596287b83538bdd769c91746d548be968318a7fb0f073cd65 WatchSource:0}: Error finding container 67295d1e7a98251596287b83538bdd769c91746d548be968318a7fb0f073cd65: Status 404 returned error can't find the container with id 67295d1e7a98251596287b83538bdd769c91746d548be968318a7fb0f073cd65 Jul 16 00:52:37.828368 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:37.828336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" event={"ID":"8d99340a-8592-4ea8-8669-71356f98347a","Type":"ContainerStarted","Data":"67295d1e7a98251596287b83538bdd769c91746d548be968318a7fb0f073cd65"} Jul 16 00:52:38.051576 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.051546 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f"] Jul 16 00:52:38.055930 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.055913 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.067211 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.067189 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 00:52:38.067354 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.067256 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 00:52:38.067406 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.067354 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 00:52:38.067484 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.067471 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 00:52:38.067928 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.067916 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wdc6\"" Jul 16 00:52:38.088471 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.088418 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f"] Jul 16 00:52:38.206839 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.206800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3ec458c-3cd1-4814-9f17-69ac133c3368-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.207059 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.206880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3ec458c-3cd1-4814-9f17-69ac133c3368-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.207059 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.206906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3ec458c-3cd1-4814-9f17-69ac133c3368-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.207059 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.206947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3ec458c-3cd1-4814-9f17-69ac133c3368-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.207242 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.207056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdhm\" (UniqueName: \"kubernetes.io/projected/a3ec458c-3cd1-4814-9f17-69ac133c3368-kube-api-access-kcdhm\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.308481 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.308440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3ec458c-3cd1-4814-9f17-69ac133c3368-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.308663 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.308496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3ec458c-3cd1-4814-9f17-69ac133c3368-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.308663 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.308542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3ec458c-3cd1-4814-9f17-69ac133c3368-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.308663 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.308582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdhm\" (UniqueName: \"kubernetes.io/projected/a3ec458c-3cd1-4814-9f17-69ac133c3368-kube-api-access-kcdhm\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.308663 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.308607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3ec458c-3cd1-4814-9f17-69ac133c3368-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.309195 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.309141 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3ec458c-3cd1-4814-9f17-69ac133c3368-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.311928 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.311903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3ec458c-3cd1-4814-9f17-69ac133c3368-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.312137 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.312094 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3ec458c-3cd1-4814-9f17-69ac133c3368-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.312309 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.312263 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3ec458c-3cd1-4814-9f17-69ac133c3368-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.317801 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.317777 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdhm\" (UniqueName: \"kubernetes.io/projected/a3ec458c-3cd1-4814-9f17-69ac133c3368-kube-api-access-kcdhm\") pod \"opendatahub-operator-controller-manager-795c7898c9-cc86f\" (UID: \"a3ec458c-3cd1-4814-9f17-69ac133c3368\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.366036 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.366004 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:38.536619 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.536592 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f"] Jul 16 00:52:38.539368 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:52:38.539336 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ec458c_3cd1_4814_9f17_69ac133c3368.slice/crio-34dd46c383fdbce11ef3f208650fe5a3383f181a544fc5a469856482ce9e8832 WatchSource:0}: Error finding container 34dd46c383fdbce11ef3f208650fe5a3383f181a544fc5a469856482ce9e8832: Status 404 returned error can't find the container with id 34dd46c383fdbce11ef3f208650fe5a3383f181a544fc5a469856482ce9e8832 Jul 16 00:52:38.835130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:38.835045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" event={"ID":"a3ec458c-3cd1-4814-9f17-69ac133c3368","Type":"ContainerStarted","Data":"34dd46c383fdbce11ef3f208650fe5a3383f181a544fc5a469856482ce9e8832"} Jul 16 00:52:42.856908 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:42.856874 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" event={"ID":"a3ec458c-3cd1-4814-9f17-69ac133c3368","Type":"ContainerStarted","Data":"4667209e01eca3c03323ad0c7a8748da55ec9c3529b19a105c9c969ac1bffe88"} Jul 16 00:52:42.858423 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:42.858402 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" event={"ID":"8d99340a-8592-4ea8-8669-71356f98347a","Type":"ContainerStarted","Data":"33c0689975d60c0e79235fe3ab6498c9975ed30606b4a82566f77e29ba862934"} Jul 16 00:52:42.858548 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:42.858534 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:42.900257 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:42.900209 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" podStartSLOduration=2.361345851 podStartE2EDuration="6.900193246s" totalImagesPullingTime="4.538847395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:42.89893156 +0000 UTC m=+511.422002816" watchObservedRunningTime="2026-07-16 00:52:42.900193246 +0000 UTC m=+511.423264501" Jul 16 00:52:43.864732 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:43.864700 2567 generic.go:356] "Generic (PLEG): container finished" podID="a3ec458c-3cd1-4814-9f17-69ac133c3368" containerID="4667209e01eca3c03323ad0c7a8748da55ec9c3529b19a105c9c969ac1bffe88" exitCode=0 Jul 16 00:52:43.865260 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:43.864792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" event={"ID":"a3ec458c-3cd1-4814-9f17-69ac133c3368","Type":"ContainerDied","Data":"4667209e01eca3c03323ad0c7a8748da55ec9c3529b19a105c9c969ac1bffe88"} Jul 16 00:52:44.870752 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:44.870720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" event={"ID":"a3ec458c-3cd1-4814-9f17-69ac133c3368","Type":"ContainerStarted","Data":"410adab77a2da2244b384d45ccc603c3b3cb1706a4f40e1d2e071bca1e794231"} Jul 16 00:52:44.871156 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:44.870845 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:44.898402 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:44.898352 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" podStartSLOduration=1.83900631 podStartE2EDuration="6.898335672s" totalImagesPullingTime="4.012820124s" totalInitContainerRuntime="1.046509238s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:44.895572517 +0000 UTC m=+513.418643771" watchObservedRunningTime="2026-07-16 00:52:44.898335672 +0000 UTC m=+513.421406927" Jul 16 00:52:53.867273 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:53.867239 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-mktwj" Jul 16 00:52:55.880215 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:55.880183 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-cc86f" Jul 16 00:52:58.196627 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.196596 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp"] Jul 16 00:52:58.205093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.205069 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.207849 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.207828 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 00:52:58.207970 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.207828 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 16 00:52:58.208836 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.208812 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 16 00:52:58.208956 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.208837 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 00:52:58.208956 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.208840 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rnp6v\"" Jul 16 00:52:58.212523 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.212496 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp"] Jul 16 00:52:58.276251 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.276206 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91654066-a762-4b4c-a652-66bb6c118792-tls-certs\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.276399 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.276265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72vt\" (UniqueName: \"kubernetes.io/projected/91654066-a762-4b4c-a652-66bb6c118792-kube-api-access-m72vt\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.276445 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.276392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91654066-a762-4b4c-a652-66bb6c118792-tmp\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.377216 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.377085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91654066-a762-4b4c-a652-66bb6c118792-tls-certs\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.377216 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.377160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72vt\" (UniqueName: \"kubernetes.io/projected/91654066-a762-4b4c-a652-66bb6c118792-kube-api-access-m72vt\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.377445 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.377236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91654066-a762-4b4c-a652-66bb6c118792-tmp\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.379799 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.379773 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91654066-a762-4b4c-a652-66bb6c118792-tls-certs\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.379915 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.379844 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91654066-a762-4b4c-a652-66bb6c118792-tmp\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.389541 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.389521 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72vt\" (UniqueName: \"kubernetes.io/projected/91654066-a762-4b4c-a652-66bb6c118792-kube-api-access-m72vt\") pod \"kube-auth-proxy-5f9949ccdc-vktkp\" (UID: \"91654066-a762-4b4c-a652-66bb6c118792\") " pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.516379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.516302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" Jul 16 00:52:58.647476 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.647383 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp"] Jul 16 00:52:58.649401 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:52:58.649374 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91654066_a762_4b4c_a652_66bb6c118792.slice/crio-a22e6eb433081f8a23433a43ef1b4cc6696c75148bde27a063055c8d94cf20a7 WatchSource:0}: Error finding container a22e6eb433081f8a23433a43ef1b4cc6696c75148bde27a063055c8d94cf20a7: Status 404 returned error can't find the container with id a22e6eb433081f8a23433a43ef1b4cc6696c75148bde27a063055c8d94cf20a7 Jul 16 00:52:58.931938 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:52:58.931901 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" event={"ID":"91654066-a762-4b4c-a652-66bb6c118792","Type":"ContainerStarted","Data":"a22e6eb433081f8a23433a43ef1b4cc6696c75148bde27a063055c8d94cf20a7"} Jul 16 00:53:01.946668 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:53:01.946634 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" event={"ID":"91654066-a762-4b4c-a652-66bb6c118792","Type":"ContainerStarted","Data":"a42ab8bddf625493898c8f459bff547e60dbbe4d97ed85c6283380d353c4c617"} Jul 16 00:53:01.964285 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:53:01.964240 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f9949ccdc-vktkp" podStartSLOduration=1.067497859 podStartE2EDuration="3.964222991s" totalImagesPullingTime="2.896725132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:01.963094025 +0000 UTC m=+530.486165297" watchObservedRunningTime="2026-07-16 00:53:01.964222991 +0000 UTC m=+530.487294246" Jul 16 00:54:11.870547 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:11.870518 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:54:11.871146 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:11.870708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:54:37.898297 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.898263 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht"] Jul 16 00:54:37.901572 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.901556 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:54:37.905465 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.905434 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:54:37.906291 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.906274 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m2nfl\"" Jul 16 00:54:37.906373 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.906287 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 16 00:54:37.906373 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.906295 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:54:37.918035 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:37.918007 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht"] Jul 16 00:54:38.012873 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:38.012836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnzq\" (UniqueName: \"kubernetes.io/projected/1dec5d4c-e8e6-45d0-8392-351adb47af22-kube-api-access-7vnzq\") pod \"dns-operator-controller-manager-864dd78c4c-9dwht\" (UID: \"1dec5d4c-e8e6-45d0-8392-351adb47af22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:54:38.113507 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:38.113457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnzq\" (UniqueName: \"kubernetes.io/projected/1dec5d4c-e8e6-45d0-8392-351adb47af22-kube-api-access-7vnzq\") pod \"dns-operator-controller-manager-864dd78c4c-9dwht\" (UID: \"1dec5d4c-e8e6-45d0-8392-351adb47af22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:54:38.122079 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:38.122055 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnzq\" (UniqueName: \"kubernetes.io/projected/1dec5d4c-e8e6-45d0-8392-351adb47af22-kube-api-access-7vnzq\") pod \"dns-operator-controller-manager-864dd78c4c-9dwht\" (UID: \"1dec5d4c-e8e6-45d0-8392-351adb47af22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:54:38.212210 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:38.212139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:54:38.341462 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:38.341182 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht"] Jul 16 00:54:38.343907 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:54:38.343882 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dec5d4c_e8e6_45d0_8392_351adb47af22.slice/crio-f3449b2be83b6f80985aa8a81088cd65e5e5356d803b0843fb5b99d9833542b5 WatchSource:0}: Error finding container f3449b2be83b6f80985aa8a81088cd65e5e5356d803b0843fb5b99d9833542b5: Status 404 returned error can't find the container with id f3449b2be83b6f80985aa8a81088cd65e5e5356d803b0843fb5b99d9833542b5 Jul 16 00:54:38.345871 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:38.345857 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:54:39.349476 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:39.349408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" event={"ID":"1dec5d4c-e8e6-45d0-8392-351adb47af22","Type":"ContainerStarted","Data":"f3449b2be83b6f80985aa8a81088cd65e5e5356d803b0843fb5b99d9833542b5"} Jul 16 00:54:41.359357 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:41.359323 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" event={"ID":"1dec5d4c-e8e6-45d0-8392-351adb47af22","Type":"ContainerStarted","Data":"59712e93ce2ba416f674002294de06ad5cc3d11a4ddeaf11a5545647679d4b79"} Jul 16 00:54:41.359770 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:41.359424 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:54:41.378952 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:41.378897 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" podStartSLOduration=2.163324219 podStartE2EDuration="4.378882308s" totalImagesPullingTime="2.215558089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:54:41.37715617 +0000 UTC m=+629.900227424" watchObservedRunningTime="2026-07-16 00:54:41.378882308 +0000 UTC m=+629.901953563" Jul 16 00:54:42.362063 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.362029 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk"] Jul 16 00:54:42.365862 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.365845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.368699 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.368660 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnl4z\"" Jul 16 00:54:42.368816 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.368732 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 16 00:54:42.368816 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.368746 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 16 00:54:42.375121 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.375096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk"] Jul 16 00:54:42.449295 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.449261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8630021-3136-452f-a238-c68eb41d8843-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.449511 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.449315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8630021-3136-452f-a238-c68eb41d8843-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.449511 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.449340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tthhz\" (UniqueName: \"kubernetes.io/projected/d8630021-3136-452f-a238-c68eb41d8843-kube-api-access-tthhz\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.549874 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.549834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8630021-3136-452f-a238-c68eb41d8843-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.550060 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.549895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8630021-3136-452f-a238-c68eb41d8843-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.550060 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.549919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthhz\" (UniqueName: \"kubernetes.io/projected/d8630021-3136-452f-a238-c68eb41d8843-kube-api-access-tthhz\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.550523 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.550503 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8630021-3136-452f-a238-c68eb41d8843-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.552614 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.552591 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8630021-3136-452f-a238-c68eb41d8843-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.559174 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.559142 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tthhz\" (UniqueName: \"kubernetes.io/projected/d8630021-3136-452f-a238-c68eb41d8843-kube-api-access-tthhz\") pod \"kuadrant-console-plugin-66b5774985-5czpk\" (UID: \"d8630021-3136-452f-a238-c68eb41d8843\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.675130 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.675035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" Jul 16 00:54:42.803715 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:42.803683 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk"] Jul 16 00:54:42.807248 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:54:42.807221 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8630021_3136_452f_a238_c68eb41d8843.slice/crio-c44222cde502fa2e83fdd65826946302db71fccf6c884ceb7ae7084a1f8b3410 WatchSource:0}: Error finding container c44222cde502fa2e83fdd65826946302db71fccf6c884ceb7ae7084a1f8b3410: Status 404 returned error can't find the container with id c44222cde502fa2e83fdd65826946302db71fccf6c884ceb7ae7084a1f8b3410 Jul 16 00:54:43.369853 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:43.369811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" event={"ID":"d8630021-3136-452f-a238-c68eb41d8843","Type":"ContainerStarted","Data":"c44222cde502fa2e83fdd65826946302db71fccf6c884ceb7ae7084a1f8b3410"} Jul 16 00:54:52.366305 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:54:52.366106 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9dwht" Jul 16 00:55:06.497727 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:06.497689 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" event={"ID":"d8630021-3136-452f-a238-c68eb41d8843","Type":"ContainerStarted","Data":"a031f4d42e2861897b7a88626c2582dd7361ddf16dfd3ceb1523fc1c4bbe7777"} Jul 16 00:55:06.516469 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:06.516419 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5czpk" podStartSLOduration=1.660511037 podStartE2EDuration="24.516404238s" totalImagesPullingTime="22.855893201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:06.515558687 +0000 UTC m=+655.038629934" watchObservedRunningTime="2026-07-16 00:55:06.516404238 +0000 UTC m=+655.039475493" Jul 16 00:55:23.373615 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.373578 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:23.412268 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.412231 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:23.412435 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.412357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.415497 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.415478 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 16 00:55:23.464004 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.463959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:23.519519 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.519486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7dc7\" (UniqueName: \"kubernetes.io/projected/c33937fd-755d-4225-9dd6-79670901dc2d-kube-api-access-t7dc7\") pod \"limitador-limitador-64c94fd64f-sqlpf\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.519713 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.519570 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c33937fd-755d-4225-9dd6-79670901dc2d-config-file\") pod \"limitador-limitador-64c94fd64f-sqlpf\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.620396 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.620355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7dc7\" (UniqueName: \"kubernetes.io/projected/c33937fd-755d-4225-9dd6-79670901dc2d-kube-api-access-t7dc7\") pod \"limitador-limitador-64c94fd64f-sqlpf\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.620599 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.620427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c33937fd-755d-4225-9dd6-79670901dc2d-config-file\") pod \"limitador-limitador-64c94fd64f-sqlpf\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.621151 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.621127 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c33937fd-755d-4225-9dd6-79670901dc2d-config-file\") pod \"limitador-limitador-64c94fd64f-sqlpf\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.629861 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.629803 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7dc7\" (UniqueName: \"kubernetes.io/projected/c33937fd-755d-4225-9dd6-79670901dc2d-kube-api-access-t7dc7\") pod \"limitador-limitador-64c94fd64f-sqlpf\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.722754 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.722716 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:23.856022 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:23.855970 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:23.858583 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:55:23.858556 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33937fd_755d_4225_9dd6_79670901dc2d.slice/crio-c7e0317002e32742de9d2b4c9e12527addef3a86da7a31ea301ce738e8a91f1c WatchSource:0}: Error finding container c7e0317002e32742de9d2b4c9e12527addef3a86da7a31ea301ce738e8a91f1c: Status 404 returned error can't find the container with id c7e0317002e32742de9d2b4c9e12527addef3a86da7a31ea301ce738e8a91f1c Jul 16 00:55:24.504890 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.504853 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-75vtb"] Jul 16 00:55:24.509086 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.509068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:24.512104 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.512084 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rlcw9\"" Jul 16 00:55:24.525792 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.525765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-75vtb"] Jul 16 00:55:24.578707 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.578660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" event={"ID":"c33937fd-755d-4225-9dd6-79670901dc2d","Type":"ContainerStarted","Data":"c7e0317002e32742de9d2b4c9e12527addef3a86da7a31ea301ce738e8a91f1c"} Jul 16 00:55:24.629458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.629423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfwrx\" (UniqueName: \"kubernetes.io/projected/6c28f311-2b6a-45d0-a869-4d079e47ab65-kube-api-access-jfwrx\") pod \"authorino-75d556bd77-75vtb\" (UID: \"6c28f311-2b6a-45d0-a869-4d079e47ab65\") " pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:24.730493 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.730389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfwrx\" (UniqueName: \"kubernetes.io/projected/6c28f311-2b6a-45d0-a869-4d079e47ab65-kube-api-access-jfwrx\") pod \"authorino-75d556bd77-75vtb\" (UID: \"6c28f311-2b6a-45d0-a869-4d079e47ab65\") " pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:24.749103 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.749043 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfwrx\" (UniqueName: \"kubernetes.io/projected/6c28f311-2b6a-45d0-a869-4d079e47ab65-kube-api-access-jfwrx\") pod \"authorino-75d556bd77-75vtb\" (UID: \"6c28f311-2b6a-45d0-a869-4d079e47ab65\") " pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:24.819859 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.819776 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:24.995802 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:24.995749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-75vtb"] Jul 16 00:55:24.999125 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:55:24.999096 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c28f311_2b6a_45d0_a869_4d079e47ab65.slice/crio-02a2a9c60a06219b0ee0c7ad6608505423ee48a11b781562e7fd5bf6cf964838 WatchSource:0}: Error finding container 02a2a9c60a06219b0ee0c7ad6608505423ee48a11b781562e7fd5bf6cf964838: Status 404 returned error can't find the container with id 02a2a9c60a06219b0ee0c7ad6608505423ee48a11b781562e7fd5bf6cf964838 Jul 16 00:55:25.585488 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:25.585449 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-75vtb" event={"ID":"6c28f311-2b6a-45d0-a869-4d079e47ab65","Type":"ContainerStarted","Data":"02a2a9c60a06219b0ee0c7ad6608505423ee48a11b781562e7fd5bf6cf964838"} Jul 16 00:55:27.599431 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:27.599393 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" event={"ID":"c33937fd-755d-4225-9dd6-79670901dc2d","Type":"ContainerStarted","Data":"810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750"} Jul 16 00:55:27.600000 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:27.599535 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:27.619040 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:27.618964 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" podStartSLOduration=1.696980043 podStartE2EDuration="4.6189465s" totalImagesPullingTime="2.921966457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:27.617924263 +0000 UTC m=+676.140995541" watchObservedRunningTime="2026-07-16 00:55:27.6189465 +0000 UTC m=+676.142017755" Jul 16 00:55:29.616286 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:29.616247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-75vtb" event={"ID":"6c28f311-2b6a-45d0-a869-4d079e47ab65","Type":"ContainerStarted","Data":"ffaadc2519026a8ffee9ab782eea0213c28903e4759b721a9b0a2d4a2de1049c"} Jul 16 00:55:29.633450 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:29.633400 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-75vtb" podStartSLOduration=2.031958155 podStartE2EDuration="5.633384883s" totalImagesPullingTime="3.601426728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:29.63148486 +0000 UTC m=+678.154556116" watchObservedRunningTime="2026-07-16 00:55:29.633384883 +0000 UTC m=+678.156456137" Jul 16 00:55:37.953397 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:37.953357 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:37.953809 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:37.953562 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" podUID="c33937fd-755d-4225-9dd6-79670901dc2d" containerName="limitador" containerID="cri-o://810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750" gracePeriod=30 Jul 16 00:55:37.954246 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:37.954228 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:38.514440 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.514386 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:38.550108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.550075 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7dc7\" (UniqueName: \"kubernetes.io/projected/c33937fd-755d-4225-9dd6-79670901dc2d-kube-api-access-t7dc7\") pod \"c33937fd-755d-4225-9dd6-79670901dc2d\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " Jul 16 00:55:38.550108 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.550112 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c33937fd-755d-4225-9dd6-79670901dc2d-config-file\") pod \"c33937fd-755d-4225-9dd6-79670901dc2d\" (UID: \"c33937fd-755d-4225-9dd6-79670901dc2d\") " Jul 16 00:55:38.550587 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.550558 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33937fd-755d-4225-9dd6-79670901dc2d-config-file" (OuterVolumeSpecName: "config-file") pod "c33937fd-755d-4225-9dd6-79670901dc2d" (UID: "c33937fd-755d-4225-9dd6-79670901dc2d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:55:38.552336 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.552312 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33937fd-755d-4225-9dd6-79670901dc2d-kube-api-access-t7dc7" (OuterVolumeSpecName: "kube-api-access-t7dc7") pod "c33937fd-755d-4225-9dd6-79670901dc2d" (UID: "c33937fd-755d-4225-9dd6-79670901dc2d"). InnerVolumeSpecName "kube-api-access-t7dc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:38.650714 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.650684 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7dc7\" (UniqueName: \"kubernetes.io/projected/c33937fd-755d-4225-9dd6-79670901dc2d-kube-api-access-t7dc7\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:55:38.650830 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.650718 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c33937fd-755d-4225-9dd6-79670901dc2d-config-file\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:55:38.655286 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.655259 2567 generic.go:356] "Generic (PLEG): container finished" podID="c33937fd-755d-4225-9dd6-79670901dc2d" containerID="810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750" exitCode=0 Jul 16 00:55:38.655373 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.655302 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" Jul 16 00:55:38.655373 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.655335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" event={"ID":"c33937fd-755d-4225-9dd6-79670901dc2d","Type":"ContainerDied","Data":"810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750"} Jul 16 00:55:38.655455 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.655380 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqlpf" event={"ID":"c33937fd-755d-4225-9dd6-79670901dc2d","Type":"ContainerDied","Data":"c7e0317002e32742de9d2b4c9e12527addef3a86da7a31ea301ce738e8a91f1c"} Jul 16 00:55:38.655455 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.655404 2567 scope.go:117] "RemoveContainer" containerID="810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750" Jul 16 00:55:38.663779 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.663757 2567 scope.go:117] "RemoveContainer" containerID="810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750" Jul 16 00:55:38.664047 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:55:38.664030 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750\": container with ID starting with 810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750 not found: ID does not exist" containerID="810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750" Jul 16 00:55:38.664106 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.664056 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750"} err="failed to get container status \"810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750\": rpc error: code = NotFound desc = could not find container \"810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750\": container with ID starting with 810045d2134c4382027111f9bfedacff2342c820daccf8aba0d950ca6c427750 not found: ID does not exist" Jul 16 00:55:38.676320 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.676294 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:38.680429 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:38.680408 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqlpf"] Jul 16 00:55:39.926938 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.926908 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5szqj"] Jul 16 00:55:39.927447 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.927425 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33937fd-755d-4225-9dd6-79670901dc2d" containerName="limitador" Jul 16 00:55:39.927522 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.927450 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33937fd-755d-4225-9dd6-79670901dc2d" containerName="limitador" Jul 16 00:55:39.927576 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.927560 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33937fd-755d-4225-9dd6-79670901dc2d" containerName="limitador" Jul 16 00:55:39.931926 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.931905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:39.934621 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.934596 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 00:55:39.934847 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.934831 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 16 00:55:39.934955 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.934911 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-whgrr\"" Jul 16 00:55:39.935502 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.935487 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 00:55:39.945642 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.945619 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5szqj"] Jul 16 00:55:39.961696 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.961668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29kmw\" (UniqueName: \"kubernetes.io/projected/a8f27ef0-0cbc-458e-936c-e65fecd1ed05-kube-api-access-29kmw\") pod \"postgres-69fb4594cf-5szqj\" (UID: \"a8f27ef0-0cbc-458e-936c-e65fecd1ed05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:39.961797 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.961711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8f27ef0-0cbc-458e-936c-e65fecd1ed05-data\") pod \"postgres-69fb4594cf-5szqj\" (UID: \"a8f27ef0-0cbc-458e-936c-e65fecd1ed05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:39.972122 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:39.972095 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c33937fd-755d-4225-9dd6-79670901dc2d" path="/var/lib/kubelet/pods/c33937fd-755d-4225-9dd6-79670901dc2d/volumes" Jul 16 00:55:40.062719 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.062679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29kmw\" (UniqueName: \"kubernetes.io/projected/a8f27ef0-0cbc-458e-936c-e65fecd1ed05-kube-api-access-29kmw\") pod \"postgres-69fb4594cf-5szqj\" (UID: \"a8f27ef0-0cbc-458e-936c-e65fecd1ed05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:40.062879 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.062737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8f27ef0-0cbc-458e-936c-e65fecd1ed05-data\") pod \"postgres-69fb4594cf-5szqj\" (UID: \"a8f27ef0-0cbc-458e-936c-e65fecd1ed05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:40.063139 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.063122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8f27ef0-0cbc-458e-936c-e65fecd1ed05-data\") pod \"postgres-69fb4594cf-5szqj\" (UID: \"a8f27ef0-0cbc-458e-936c-e65fecd1ed05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:40.071932 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.071898 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29kmw\" (UniqueName: \"kubernetes.io/projected/a8f27ef0-0cbc-458e-936c-e65fecd1ed05-kube-api-access-29kmw\") pod \"postgres-69fb4594cf-5szqj\" (UID: \"a8f27ef0-0cbc-458e-936c-e65fecd1ed05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:40.242647 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.242556 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:40.378705 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.378676 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5szqj"] Jul 16 00:55:40.381086 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:55:40.381051 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f27ef0_0cbc_458e_936c_e65fecd1ed05.slice/crio-f1cc61ca3a9bc58f14c229ce9d28113eab917665116544bc48caa730aa3a2bcf WatchSource:0}: Error finding container f1cc61ca3a9bc58f14c229ce9d28113eab917665116544bc48caa730aa3a2bcf: Status 404 returned error can't find the container with id f1cc61ca3a9bc58f14c229ce9d28113eab917665116544bc48caa730aa3a2bcf Jul 16 00:55:40.672574 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:40.672534 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" event={"ID":"a8f27ef0-0cbc-458e-936c-e65fecd1ed05","Type":"ContainerStarted","Data":"f1cc61ca3a9bc58f14c229ce9d28113eab917665116544bc48caa730aa3a2bcf"} Jul 16 00:55:45.701055 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:45.701017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" event={"ID":"a8f27ef0-0cbc-458e-936c-e65fecd1ed05","Type":"ContainerStarted","Data":"48d75df0831d96ebb42f33e9cdab9e7484d1d7e1f4bd602720991b873c16425c"} Jul 16 00:55:45.701539 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:45.701121 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:45.721446 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:45.721402 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" podStartSLOduration=2.018873524 podStartE2EDuration="6.721387579s" totalImagesPullingTime="4.702514055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:45.719888144 +0000 UTC m=+694.242959404" watchObservedRunningTime="2026-07-16 00:55:45.721387579 +0000 UTC m=+694.244458833" Jul 16 00:55:51.734966 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:51.734939 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5szqj" Jul 16 00:55:52.266620 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.266581 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlvmf"] Jul 16 00:55:52.271616 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.271598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:52.280805 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.280783 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlvmf"] Jul 16 00:55:52.380246 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.380215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cppxw\" (UniqueName: \"kubernetes.io/projected/6c81bfdb-3983-4a94-9d7b-cae235830f0b-kube-api-access-cppxw\") pod \"authorino-5d4b67c446-hlvmf\" (UID: \"6c81bfdb-3983-4a94-9d7b-cae235830f0b\") " pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:52.481249 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.481216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cppxw\" (UniqueName: \"kubernetes.io/projected/6c81bfdb-3983-4a94-9d7b-cae235830f0b-kube-api-access-cppxw\") pod \"authorino-5d4b67c446-hlvmf\" (UID: \"6c81bfdb-3983-4a94-9d7b-cae235830f0b\") " pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:52.494184 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.494150 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cppxw\" (UniqueName: \"kubernetes.io/projected/6c81bfdb-3983-4a94-9d7b-cae235830f0b-kube-api-access-cppxw\") pod \"authorino-5d4b67c446-hlvmf\" (UID: \"6c81bfdb-3983-4a94-9d7b-cae235830f0b\") " pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:52.502345 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.500460 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlvmf"] Jul 16 00:55:52.502345 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.501157 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:52.634085 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.634052 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlvmf"] Jul 16 00:55:52.637087 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:55:52.637061 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c81bfdb_3983_4a94_9d7b_cae235830f0b.slice/crio-b3c2cbcffe4f9727f439cc6dd55003244de9e3fcfc7448c95e12713c15ff03e3 WatchSource:0}: Error finding container b3c2cbcffe4f9727f439cc6dd55003244de9e3fcfc7448c95e12713c15ff03e3: Status 404 returned error can't find the container with id b3c2cbcffe4f9727f439cc6dd55003244de9e3fcfc7448c95e12713c15ff03e3 Jul 16 00:55:52.733494 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:52.733465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" event={"ID":"6c81bfdb-3983-4a94-9d7b-cae235830f0b","Type":"ContainerStarted","Data":"b3c2cbcffe4f9727f439cc6dd55003244de9e3fcfc7448c95e12713c15ff03e3"} Jul 16 00:55:53.739106 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:53.739057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" event={"ID":"6c81bfdb-3983-4a94-9d7b-cae235830f0b","Type":"ContainerStarted","Data":"e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c"} Jul 16 00:55:53.739106 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:53.739104 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" podUID="6c81bfdb-3983-4a94-9d7b-cae235830f0b" containerName="authorino" containerID="cri-o://e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c" gracePeriod=30 Jul 16 00:55:53.754558 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:53.754506 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" podStartSLOduration=1.425731575 podStartE2EDuration="1.75448726s" totalImagesPullingTime="328.755685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:53.753575257 +0000 UTC m=+702.276646513" watchObservedRunningTime="2026-07-16 00:55:53.75448726 +0000 UTC m=+702.277558584" Jul 16 00:55:54.015468 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.015441 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:54.095502 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.095467 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cppxw\" (UniqueName: \"kubernetes.io/projected/6c81bfdb-3983-4a94-9d7b-cae235830f0b-kube-api-access-cppxw\") pod \"6c81bfdb-3983-4a94-9d7b-cae235830f0b\" (UID: \"6c81bfdb-3983-4a94-9d7b-cae235830f0b\") " Jul 16 00:55:54.097710 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.097683 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c81bfdb-3983-4a94-9d7b-cae235830f0b-kube-api-access-cppxw" (OuterVolumeSpecName: "kube-api-access-cppxw") pod "6c81bfdb-3983-4a94-9d7b-cae235830f0b" (UID: "6c81bfdb-3983-4a94-9d7b-cae235830f0b"). InnerVolumeSpecName "kube-api-access-cppxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:54.196574 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.196537 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cppxw\" (UniqueName: \"kubernetes.io/projected/6c81bfdb-3983-4a94-9d7b-cae235830f0b-kube-api-access-cppxw\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:55:54.573358 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.573326 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-75vtb"] Jul 16 00:55:54.573529 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.573511 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-75vtb" podUID="6c28f311-2b6a-45d0-a869-4d079e47ab65" containerName="authorino" containerID="cri-o://ffaadc2519026a8ffee9ab782eea0213c28903e4759b721a9b0a2d4a2de1049c" gracePeriod=30 Jul 16 00:55:54.745507 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.745478 2567 generic.go:356] "Generic (PLEG): container finished" podID="6c81bfdb-3983-4a94-9d7b-cae235830f0b" containerID="e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c" exitCode=0 Jul 16 00:55:54.745974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.745521 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" Jul 16 00:55:54.745974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.745555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" event={"ID":"6c81bfdb-3983-4a94-9d7b-cae235830f0b","Type":"ContainerDied","Data":"e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c"} Jul 16 00:55:54.745974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.745584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hlvmf" event={"ID":"6c81bfdb-3983-4a94-9d7b-cae235830f0b","Type":"ContainerDied","Data":"b3c2cbcffe4f9727f439cc6dd55003244de9e3fcfc7448c95e12713c15ff03e3"} Jul 16 00:55:54.745974 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.745600 2567 scope.go:117] "RemoveContainer" containerID="e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c" Jul 16 00:55:54.747583 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.747550 2567 generic.go:356] "Generic (PLEG): container finished" podID="6c28f311-2b6a-45d0-a869-4d079e47ab65" containerID="ffaadc2519026a8ffee9ab782eea0213c28903e4759b721a9b0a2d4a2de1049c" exitCode=0 Jul 16 00:55:54.747703 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.747611 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-75vtb" event={"ID":"6c28f311-2b6a-45d0-a869-4d079e47ab65","Type":"ContainerDied","Data":"ffaadc2519026a8ffee9ab782eea0213c28903e4759b721a9b0a2d4a2de1049c"} Jul 16 00:55:54.755954 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.755868 2567 scope.go:117] "RemoveContainer" containerID="e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c" Jul 16 00:55:54.756323 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:55:54.756256 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c\": container with ID starting with e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c not found: ID does not exist" containerID="e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c" Jul 16 00:55:54.756323 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.756291 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c"} err="failed to get container status \"e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c\": rpc error: code = NotFound desc = could not find container \"e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c\": container with ID starting with e8870c7d352bda3df46ca30e0f95e618137c65d14218af01ebc841e3ef877f8c not found: ID does not exist" Jul 16 00:55:54.766660 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.766612 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlvmf"] Jul 16 00:55:54.775835 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.775803 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlvmf"] Jul 16 00:55:54.863367 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:54.863338 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:55.003958 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.003919 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfwrx\" (UniqueName: \"kubernetes.io/projected/6c28f311-2b6a-45d0-a869-4d079e47ab65-kube-api-access-jfwrx\") pod \"6c28f311-2b6a-45d0-a869-4d079e47ab65\" (UID: \"6c28f311-2b6a-45d0-a869-4d079e47ab65\") " Jul 16 00:55:55.006198 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.006171 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c28f311-2b6a-45d0-a869-4d079e47ab65-kube-api-access-jfwrx" (OuterVolumeSpecName: "kube-api-access-jfwrx") pod "6c28f311-2b6a-45d0-a869-4d079e47ab65" (UID: "6c28f311-2b6a-45d0-a869-4d079e47ab65"). InnerVolumeSpecName "kube-api-access-jfwrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:55.105402 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.105372 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfwrx\" (UniqueName: \"kubernetes.io/projected/6c28f311-2b6a-45d0-a869-4d079e47ab65-kube-api-access-jfwrx\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:55:55.754561 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.754530 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-75vtb" Jul 16 00:55:55.754973 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.754574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-75vtb" event={"ID":"6c28f311-2b6a-45d0-a869-4d079e47ab65","Type":"ContainerDied","Data":"02a2a9c60a06219b0ee0c7ad6608505423ee48a11b781562e7fd5bf6cf964838"} Jul 16 00:55:55.754973 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.754622 2567 scope.go:117] "RemoveContainer" containerID="ffaadc2519026a8ffee9ab782eea0213c28903e4759b721a9b0a2d4a2de1049c" Jul 16 00:55:55.774719 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.774690 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-75vtb"] Jul 16 00:55:55.778849 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.778828 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-75vtb"] Jul 16 00:55:55.973400 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.973369 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c28f311-2b6a-45d0-a869-4d079e47ab65" path="/var/lib/kubelet/pods/6c28f311-2b6a-45d0-a869-4d079e47ab65/volumes" Jul 16 00:55:55.973691 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:55.973678 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c81bfdb-3983-4a94-9d7b-cae235830f0b" path="/var/lib/kubelet/pods/6c81bfdb-3983-4a94-9d7b-cae235830f0b/volumes" Jul 16 00:55:59.288041 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288003 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765dccf54d-nrcb9"] Jul 16 00:55:59.288408 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288353 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c81bfdb-3983-4a94-9d7b-cae235830f0b" containerName="authorino" Jul 16 00:55:59.288408 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288364 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c81bfdb-3983-4a94-9d7b-cae235830f0b" containerName="authorino" Jul 16 00:55:59.288408 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288374 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c28f311-2b6a-45d0-a869-4d079e47ab65" containerName="authorino" Jul 16 00:55:59.288408 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288379 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c28f311-2b6a-45d0-a869-4d079e47ab65" containerName="authorino" Jul 16 00:55:59.288543 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288466 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c81bfdb-3983-4a94-9d7b-cae235830f0b" containerName="authorino" Jul 16 00:55:59.288543 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.288479 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c28f311-2b6a-45d0-a869-4d079e47ab65" containerName="authorino" Jul 16 00:55:59.304866 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.304841 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.307784 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.307758 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 00:55:59.307947 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.307857 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s52s6\"" Jul 16 00:55:59.307947 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.307819 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 00:55:59.308797 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.308778 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765dccf54d-nrcb9"] Jul 16 00:55:59.443461 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.443420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9211937b-efa0-4a87-bec7-4c2de8f76c73-webhook-cert\") pod \"maas-controller-765dccf54d-nrcb9\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.443461 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.443463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vskb8\" (UniqueName: \"kubernetes.io/projected/9211937b-efa0-4a87-bec7-4c2de8f76c73-kube-api-access-vskb8\") pod \"maas-controller-765dccf54d-nrcb9\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.457045 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.457007 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-zdtqq"] Jul 16 00:55:59.459248 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.459227 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.471958 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.471932 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-zdtqq"] Jul 16 00:55:59.544172 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.544080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9211937b-efa0-4a87-bec7-4c2de8f76c73-webhook-cert\") pod \"maas-controller-765dccf54d-nrcb9\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.544172 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.544116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e850645-3f0e-46db-8112-505114c3abcc-webhook-cert\") pod \"maas-controller-68d8bbbcf5-zdtqq\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.544172 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.544144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm6ms\" (UniqueName: \"kubernetes.io/projected/9e850645-3f0e-46db-8112-505114c3abcc-kube-api-access-lm6ms\") pod \"maas-controller-68d8bbbcf5-zdtqq\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.544172 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.544161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vskb8\" (UniqueName: \"kubernetes.io/projected/9211937b-efa0-4a87-bec7-4c2de8f76c73-kube-api-access-vskb8\") pod \"maas-controller-765dccf54d-nrcb9\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.546696 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.546666 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9211937b-efa0-4a87-bec7-4c2de8f76c73-webhook-cert\") pod \"maas-controller-765dccf54d-nrcb9\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.552913 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.552891 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vskb8\" (UniqueName: \"kubernetes.io/projected/9211937b-efa0-4a87-bec7-4c2de8f76c73-kube-api-access-vskb8\") pod \"maas-controller-765dccf54d-nrcb9\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.615939 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.615903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:55:59.645253 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.645225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e850645-3f0e-46db-8112-505114c3abcc-webhook-cert\") pod \"maas-controller-68d8bbbcf5-zdtqq\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.645397 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.645265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm6ms\" (UniqueName: \"kubernetes.io/projected/9e850645-3f0e-46db-8112-505114c3abcc-kube-api-access-lm6ms\") pod \"maas-controller-68d8bbbcf5-zdtqq\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.647838 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.647810 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e850645-3f0e-46db-8112-505114c3abcc-webhook-cert\") pod \"maas-controller-68d8bbbcf5-zdtqq\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.655211 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.655184 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm6ms\" (UniqueName: \"kubernetes.io/projected/9e850645-3f0e-46db-8112-505114c3abcc-kube-api-access-lm6ms\") pod \"maas-controller-68d8bbbcf5-zdtqq\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.748254 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.748226 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765dccf54d-nrcb9"] Jul 16 00:55:59.750043 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:55:59.750017 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9211937b_efa0_4a87_bec7_4c2de8f76c73.slice/crio-0843ed170c069c50c2a2b58f47760907f5c382a903f1fd4aa6e4125d41f52e32 WatchSource:0}: Error finding container 0843ed170c069c50c2a2b58f47760907f5c382a903f1fd4aa6e4125d41f52e32: Status 404 returned error can't find the container with id 0843ed170c069c50c2a2b58f47760907f5c382a903f1fd4aa6e4125d41f52e32 Jul 16 00:55:59.769045 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.769021 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:55:59.774843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.774819 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765dccf54d-nrcb9" event={"ID":"9211937b-efa0-4a87-bec7-4c2de8f76c73","Type":"ContainerStarted","Data":"0843ed170c069c50c2a2b58f47760907f5c382a903f1fd4aa6e4125d41f52e32"} Jul 16 00:55:59.897351 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:55:59.897325 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-zdtqq"] Jul 16 00:55:59.899447 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:55:59.899424 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e850645_3f0e_46db_8112_505114c3abcc.slice/crio-b85e5ecd760c9c65a6f4876789fd3a30d8fc46ce1aad68e38850ee4bfc031468 WatchSource:0}: Error finding container b85e5ecd760c9c65a6f4876789fd3a30d8fc46ce1aad68e38850ee4bfc031468: Status 404 returned error can't find the container with id b85e5ecd760c9c65a6f4876789fd3a30d8fc46ce1aad68e38850ee4bfc031468 Jul 16 00:56:00.785534 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:00.785496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" event={"ID":"9e850645-3f0e-46db-8112-505114c3abcc","Type":"ContainerStarted","Data":"b85e5ecd760c9c65a6f4876789fd3a30d8fc46ce1aad68e38850ee4bfc031468"} Jul 16 00:56:02.796157 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:02.796117 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765dccf54d-nrcb9" event={"ID":"9211937b-efa0-4a87-bec7-4c2de8f76c73","Type":"ContainerStarted","Data":"378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07"} Jul 16 00:56:02.796621 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:02.796236 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:56:02.797652 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:02.797628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" event={"ID":"9e850645-3f0e-46db-8112-505114c3abcc","Type":"ContainerStarted","Data":"82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd"} Jul 16 00:56:02.797754 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:02.797743 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:56:02.825123 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:02.825072 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-765dccf54d-nrcb9" podStartSLOduration=1.234226277 podStartE2EDuration="3.825056407s" totalImagesPullingTime="2.59083013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:02.823009923 +0000 UTC m=+711.346081198" watchObservedRunningTime="2026-07-16 00:56:02.825056407 +0000 UTC m=+711.348127709" Jul 16 00:56:02.843390 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:02.843340 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" podStartSLOduration=1.394911669 podStartE2EDuration="3.843324356s" totalImagesPullingTime="2.448412687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:02.84154074 +0000 UTC m=+711.364612009" watchObservedRunningTime="2026-07-16 00:56:02.843324356 +0000 UTC m=+711.366395642" Jul 16 00:56:13.803918 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:13.803885 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:56:13.804321 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:13.803964 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 00:56:13.880766 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:13.876281 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765dccf54d-nrcb9"] Jul 16 00:56:13.880766 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:13.876513 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-765dccf54d-nrcb9" podUID="9211937b-efa0-4a87-bec7-4c2de8f76c73" containerName="manager" containerID="cri-o://378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07" gracePeriod=30 Jul 16 00:56:14.134938 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.134910 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:56:14.184701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.184670 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vskb8\" (UniqueName: \"kubernetes.io/projected/9211937b-efa0-4a87-bec7-4c2de8f76c73-kube-api-access-vskb8\") pod \"9211937b-efa0-4a87-bec7-4c2de8f76c73\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " Jul 16 00:56:14.184866 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.184748 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9211937b-efa0-4a87-bec7-4c2de8f76c73-webhook-cert\") pod \"9211937b-efa0-4a87-bec7-4c2de8f76c73\" (UID: \"9211937b-efa0-4a87-bec7-4c2de8f76c73\") " Jul 16 00:56:14.187000 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.186966 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9211937b-efa0-4a87-bec7-4c2de8f76c73-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9211937b-efa0-4a87-bec7-4c2de8f76c73" (UID: "9211937b-efa0-4a87-bec7-4c2de8f76c73"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:56:14.187118 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.187005 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9211937b-efa0-4a87-bec7-4c2de8f76c73-kube-api-access-vskb8" (OuterVolumeSpecName: "kube-api-access-vskb8") pod "9211937b-efa0-4a87-bec7-4c2de8f76c73" (UID: "9211937b-efa0-4a87-bec7-4c2de8f76c73"). InnerVolumeSpecName "kube-api-access-vskb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:56:14.286340 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.286308 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vskb8\" (UniqueName: \"kubernetes.io/projected/9211937b-efa0-4a87-bec7-4c2de8f76c73-kube-api-access-vskb8\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:56:14.286340 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.286333 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9211937b-efa0-4a87-bec7-4c2de8f76c73-webhook-cert\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 00:56:14.877623 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.877593 2567 generic.go:356] "Generic (PLEG): container finished" podID="9211937b-efa0-4a87-bec7-4c2de8f76c73" containerID="378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07" exitCode=0 Jul 16 00:56:14.878084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.877639 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765dccf54d-nrcb9" Jul 16 00:56:14.878084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.877667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765dccf54d-nrcb9" event={"ID":"9211937b-efa0-4a87-bec7-4c2de8f76c73","Type":"ContainerDied","Data":"378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07"} Jul 16 00:56:14.878084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.877708 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765dccf54d-nrcb9" event={"ID":"9211937b-efa0-4a87-bec7-4c2de8f76c73","Type":"ContainerDied","Data":"0843ed170c069c50c2a2b58f47760907f5c382a903f1fd4aa6e4125d41f52e32"} Jul 16 00:56:14.878084 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.877732 2567 scope.go:117] "RemoveContainer" containerID="378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07" Jul 16 00:56:14.886604 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.886408 2567 scope.go:117] "RemoveContainer" containerID="378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07" Jul 16 00:56:14.886662 ip-10-0-142-151 kubenswrapper[2567]: E0716 00:56:14.886648 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07\": container with ID starting with 378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07 not found: ID does not exist" containerID="378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07" Jul 16 00:56:14.886701 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.886671 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07"} err="failed to get container status \"378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07\": rpc error: code = NotFound desc = could not find container \"378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07\": container with ID starting with 378089d4ca5cdc871718b2f395cbed5277269699a3e8c92f3e98ef5429786c07 not found: ID does not exist" Jul 16 00:56:14.899896 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.899861 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765dccf54d-nrcb9"] Jul 16 00:56:14.901945 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:14.901923 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-765dccf54d-nrcb9"] Jul 16 00:56:15.972288 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:15.972252 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9211937b-efa0-4a87-bec7-4c2de8f76c73" path="/var/lib/kubelet/pods/9211937b-efa0-4a87-bec7-4c2de8f76c73/volumes" Jul 16 00:56:31.785672 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.785629 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp"] Jul 16 00:56:31.786171 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.786043 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9211937b-efa0-4a87-bec7-4c2de8f76c73" containerName="manager" Jul 16 00:56:31.786171 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.786057 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9211937b-efa0-4a87-bec7-4c2de8f76c73" containerName="manager" Jul 16 00:56:31.786171 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.786112 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9211937b-efa0-4a87-bec7-4c2de8f76c73" containerName="manager" Jul 16 00:56:31.790496 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.790477 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:31.794134 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.794112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4n4k8\"" Jul 16 00:56:31.794253 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.794114 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 16 00:56:31.803819 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.803792 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp"] Jul 16 00:56:31.937266 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.937231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41408982-30ae-4f55-8cd0-53d5b7f05f44-maas-api-tls\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:31.937514 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.937379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41408982-30ae-4f55-8cd0-53d5b7f05f44-openshift-service-ca\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:31.937514 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:31.937415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw42f\" (UniqueName: \"kubernetes.io/projected/41408982-30ae-4f55-8cd0-53d5b7f05f44-kube-api-access-mw42f\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.038843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.038750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41408982-30ae-4f55-8cd0-53d5b7f05f44-openshift-service-ca\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.038843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.038787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw42f\" (UniqueName: \"kubernetes.io/projected/41408982-30ae-4f55-8cd0-53d5b7f05f44-kube-api-access-mw42f\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.038843 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.038818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41408982-30ae-4f55-8cd0-53d5b7f05f44-maas-api-tls\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.039478 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.039447 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41408982-30ae-4f55-8cd0-53d5b7f05f44-openshift-service-ca\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.041313 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.041285 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41408982-30ae-4f55-8cd0-53d5b7f05f44-maas-api-tls\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.051873 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.051821 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw42f\" (UniqueName: \"kubernetes.io/projected/41408982-30ae-4f55-8cd0-53d5b7f05f44-kube-api-access-mw42f\") pod \"maas-api-767bf5db7b-pfvdp\" (UID: \"41408982-30ae-4f55-8cd0-53d5b7f05f44\") " pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.100674 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.100628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:32.253896 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.253863 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp"] Jul 16 00:56:32.256683 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:56:32.256654 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41408982_30ae_4f55_8cd0_53d5b7f05f44.slice/crio-91931d68e94c818a6aaa7bea0366f6218707e65c2e766d57d58aa3343b060620 WatchSource:0}: Error finding container 91931d68e94c818a6aaa7bea0366f6218707e65c2e766d57d58aa3343b060620: Status 404 returned error can't find the container with id 91931d68e94c818a6aaa7bea0366f6218707e65c2e766d57d58aa3343b060620 Jul 16 00:56:32.317003 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.316923 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j"] Jul 16 00:56:32.321622 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.321603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.324179 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.324160 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 00:56:32.337011 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.336973 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j"] Jul 16 00:56:32.352567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.352537 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-x5m47"] Jul 16 00:56:32.355796 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.355781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.358421 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.358397 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9jm5j\"" Jul 16 00:56:32.368368 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.368346 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-x5m47"] Jul 16 00:56:32.442171 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.442138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f30f8b5-2af7-4b6d-b010-df624539e68e-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-4qj5j\" (UID: \"7f30f8b5-2af7-4b6d-b010-df624539e68e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.442171 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.442172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6494\" (UniqueName: \"kubernetes.io/projected/7f30f8b5-2af7-4b6d-b010-df624539e68e-kube-api-access-z6494\") pod \"payload-pre-processing-74584bb9f8-4qj5j\" (UID: \"7f30f8b5-2af7-4b6d-b010-df624539e68e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.442384 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.442252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cxh4\" (UniqueName: \"kubernetes.io/projected/2942b407-a7ef-456d-8fcd-9759f6fac878-kube-api-access-5cxh4\") pod \"payload-processing-f9b8d9b9b-x5m47\" (UID: \"2942b407-a7ef-456d-8fcd-9759f6fac878\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.442384 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.442363 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2942b407-a7ef-456d-8fcd-9759f6fac878-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-x5m47\" (UID: \"2942b407-a7ef-456d-8fcd-9759f6fac878\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.543535 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.543495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cxh4\" (UniqueName: \"kubernetes.io/projected/2942b407-a7ef-456d-8fcd-9759f6fac878-kube-api-access-5cxh4\") pod \"payload-processing-f9b8d9b9b-x5m47\" (UID: \"2942b407-a7ef-456d-8fcd-9759f6fac878\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.543709 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.543554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2942b407-a7ef-456d-8fcd-9759f6fac878-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-x5m47\" (UID: \"2942b407-a7ef-456d-8fcd-9759f6fac878\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.543709 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.543591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f30f8b5-2af7-4b6d-b010-df624539e68e-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-4qj5j\" (UID: \"7f30f8b5-2af7-4b6d-b010-df624539e68e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.543709 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.543609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6494\" (UniqueName: \"kubernetes.io/projected/7f30f8b5-2af7-4b6d-b010-df624539e68e-kube-api-access-z6494\") pod \"payload-pre-processing-74584bb9f8-4qj5j\" (UID: \"7f30f8b5-2af7-4b6d-b010-df624539e68e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.544420 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.544393 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2942b407-a7ef-456d-8fcd-9759f6fac878-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-x5m47\" (UID: \"2942b407-a7ef-456d-8fcd-9759f6fac878\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.544538 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.544399 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f30f8b5-2af7-4b6d-b010-df624539e68e-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-4qj5j\" (UID: \"7f30f8b5-2af7-4b6d-b010-df624539e68e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.553366 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.553345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6494\" (UniqueName: \"kubernetes.io/projected/7f30f8b5-2af7-4b6d-b010-df624539e68e-kube-api-access-z6494\") pod \"payload-pre-processing-74584bb9f8-4qj5j\" (UID: \"7f30f8b5-2af7-4b6d-b010-df624539e68e\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.553557 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.553540 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cxh4\" (UniqueName: \"kubernetes.io/projected/2942b407-a7ef-456d-8fcd-9759f6fac878-kube-api-access-5cxh4\") pod \"payload-processing-f9b8d9b9b-x5m47\" (UID: \"2942b407-a7ef-456d-8fcd-9759f6fac878\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.632510 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.632480 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:32.665933 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.665904 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:32.780666 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.780633 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j"] Jul 16 00:56:32.783880 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:56:32.783854 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f30f8b5_2af7_4b6d_b010_df624539e68e.slice/crio-04f5df10e80c4cba008715c9a483f190f0ea46566a15e59b7f7704fc56ee5b1b WatchSource:0}: Error finding container 04f5df10e80c4cba008715c9a483f190f0ea46566a15e59b7f7704fc56ee5b1b: Status 404 returned error can't find the container with id 04f5df10e80c4cba008715c9a483f190f0ea46566a15e59b7f7704fc56ee5b1b Jul 16 00:56:32.817461 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.817435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-x5m47"] Jul 16 00:56:32.819865 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:56:32.819842 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2942b407_a7ef_456d_8fcd_9759f6fac878.slice/crio-c62a11395f15d12f0c551eb4a0ca010a49924eec212fc6af926f8ab40cc7c44a WatchSource:0}: Error finding container c62a11395f15d12f0c551eb4a0ca010a49924eec212fc6af926f8ab40cc7c44a: Status 404 returned error can't find the container with id c62a11395f15d12f0c551eb4a0ca010a49924eec212fc6af926f8ab40cc7c44a Jul 16 00:56:32.961702 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.961603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" event={"ID":"7f30f8b5-2af7-4b6d-b010-df624539e68e","Type":"ContainerStarted","Data":"04f5df10e80c4cba008715c9a483f190f0ea46566a15e59b7f7704fc56ee5b1b"} Jul 16 00:56:32.962833 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.962811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" event={"ID":"2942b407-a7ef-456d-8fcd-9759f6fac878","Type":"ContainerStarted","Data":"c62a11395f15d12f0c551eb4a0ca010a49924eec212fc6af926f8ab40cc7c44a"} Jul 16 00:56:32.964005 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:32.963968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" event={"ID":"41408982-30ae-4f55-8cd0-53d5b7f05f44","Type":"ContainerStarted","Data":"91931d68e94c818a6aaa7bea0366f6218707e65c2e766d57d58aa3343b060620"} Jul 16 00:56:34.981067 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:34.981006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" event={"ID":"7f30f8b5-2af7-4b6d-b010-df624539e68e","Type":"ContainerStarted","Data":"f7e5a708e8e6abb9585597dc28e5ad243ac568157254c48c98afed88094cb449"} Jul 16 00:56:34.981585 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:34.981318 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:34.982768 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:34.982741 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" event={"ID":"2942b407-a7ef-456d-8fcd-9759f6fac878","Type":"ContainerStarted","Data":"99186b97fae6448503e5f6b20847058613885e7bd5100539cd15b59307e1aa58"} Jul 16 00:56:34.982889 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:34.982858 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:34.984458 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:34.984397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" event={"ID":"41408982-30ae-4f55-8cd0-53d5b7f05f44","Type":"ContainerStarted","Data":"b597d42a93f3d23385eafd678c105a38c0835e4c2f188f9986038c4b6029172d"} Jul 16 00:56:34.984567 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:34.984518 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:35.004140 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:35.004096 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" podStartSLOduration=1.526364956 podStartE2EDuration="3.004079511s" totalImagesPullingTime="1.477714555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:35.002355231 +0000 UTC m=+743.525426491" watchObservedRunningTime="2026-07-16 00:56:35.004079511 +0000 UTC m=+743.527150766" Jul 16 00:56:35.029374 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:35.029295 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" podStartSLOduration=2.026202825 podStartE2EDuration="4.029273344s" totalImagesPullingTime="2.003070519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:35.026911665 +0000 UTC m=+743.549982943" watchObservedRunningTime="2026-07-16 00:56:35.029273344 +0000 UTC m=+743.552344600" Jul 16 00:56:35.058088 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:35.058035 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" podStartSLOduration=1.618331694 podStartE2EDuration="3.058017231s" totalImagesPullingTime="1.439685537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:35.057035352 +0000 UTC m=+743.580106608" watchObservedRunningTime="2026-07-16 00:56:35.058017231 +0000 UTC m=+743.581088483" Jul 16 00:56:41.000736 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:41.000701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-767bf5db7b-pfvdp" Jul 16 00:56:45.991089 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:45.991057 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-x5m47" Jul 16 00:56:45.991533 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:45.991144 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4qj5j" Jul 16 00:56:50.784708 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.784673 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4"] Jul 16 00:56:50.788345 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.788328 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:50.790932 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.790907 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 00:56:50.791741 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.791722 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 00:56:50.791861 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.791843 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n7pbs\"" Jul 16 00:56:50.791914 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.791878 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 00:56:50.801630 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.801606 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4"] Jul 16 00:56:50.916067 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.916029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7thjf\" (UniqueName: \"kubernetes.io/projected/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-kube-api-access-7thjf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:50.916067 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.916067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:50.916317 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.916094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:50.916317 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.916212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:50.916317 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.916245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:50.916317 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:50.916279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017204 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7thjf\" (UniqueName: \"kubernetes.io/projected/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-kube-api-access-7thjf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017778 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017690 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017778 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017759 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.017927 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.017884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.019531 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.019511 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.019852 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.019836 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.026479 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.026453 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7thjf\" (UniqueName: \"kubernetes.io/projected/19fe0d59-86eb-4550-85ca-c6d6ba8bfea3-kube-api-access-7thjf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4\" (UID: \"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.098446 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.098416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:56:51.231379 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:51.231357 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4"] Jul 16 00:56:51.233846 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:56:51.233813 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fe0d59_86eb_4550_85ca_c6d6ba8bfea3.slice/crio-bb7d0acdce8a8a0972fdbcc83d20a0cbe6317e492fba20ef8f6ec0a88d3cfddd WatchSource:0}: Error finding container bb7d0acdce8a8a0972fdbcc83d20a0cbe6317e492fba20ef8f6ec0a88d3cfddd: Status 404 returned error can't find the container with id bb7d0acdce8a8a0972fdbcc83d20a0cbe6317e492fba20ef8f6ec0a88d3cfddd Jul 16 00:56:52.065431 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:52.065397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" event={"ID":"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3","Type":"ContainerStarted","Data":"bb7d0acdce8a8a0972fdbcc83d20a0cbe6317e492fba20ef8f6ec0a88d3cfddd"} Jul 16 00:56:53.070943 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:53.070904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" event={"ID":"19fe0d59-86eb-4550-85ca-c6d6ba8bfea3","Type":"ContainerStarted","Data":"85b73c486e4cf6240bad29b97f326a5bd710b8ab93e677e17ebcef4dcabe8536"} Jul 16 00:56:53.092008 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:56:53.091947 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" podStartSLOduration=1.912678758 podStartE2EDuration="3.091926698s" totalImagesPullingTime="1.17924794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:53.09064943 +0000 UTC m=+761.613720684" watchObservedRunningTime="2026-07-16 00:56:53.091926698 +0000 UTC m=+761.614998001" Jul 16 00:57:01.099250 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:01.099210 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:57:01.099746 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:01.099321 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:57:01.113093 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:01.113067 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:57:01.124372 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:01.124351 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4" Jul 16 00:57:12.191865 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.191781 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv"] Jul 16 00:57:12.199966 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.199930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.203607 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.203580 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 16 00:57:12.205043 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.205018 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv"] Jul 16 00:57:12.324566 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.324533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.324566 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.324566 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.324775 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.324596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.324775 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.324755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pp4g\" (UniqueName: \"kubernetes.io/projected/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-kube-api-access-5pp4g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.324855 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.324792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.324855 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.324812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.425790 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.425751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.425790 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.425787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426079 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.425816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426079 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.425907 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pp4g\" (UniqueName: \"kubernetes.io/projected/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-kube-api-access-5pp4g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426079 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.425940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426079 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.425965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426294 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.426238 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426368 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.426343 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.426416 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.426405 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.428308 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.428285 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.428473 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.428456 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.434600 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.434583 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pp4g\" (UniqueName: \"kubernetes.io/projected/9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367-kube-api-access-5pp4g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2gvmv\" (UID: \"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.512735 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.512650 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:12.645350 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:12.645328 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv"] Jul 16 00:57:12.647208 ip-10-0-142-151 kubenswrapper[2567]: W0716 00:57:12.647180 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5b2ee1_db9b_4ffd_8fd1_ef8b750e2367.slice/crio-fce4322d9881af5cc6fcb27133519a5ea79c39d6738f39938ad0bde8cfda325a WatchSource:0}: Error finding container fce4322d9881af5cc6fcb27133519a5ea79c39d6738f39938ad0bde8cfda325a: Status 404 returned error can't find the container with id fce4322d9881af5cc6fcb27133519a5ea79c39d6738f39938ad0bde8cfda325a Jul 16 00:57:13.170854 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:13.170758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" event={"ID":"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367","Type":"ContainerStarted","Data":"0e339bf5da08c20c1499eff9fdc468be9df46d4ba8006deaa09eaa5da394e312"} Jul 16 00:57:13.170854 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:13.170811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" event={"ID":"9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367","Type":"ContainerStarted","Data":"fce4322d9881af5cc6fcb27133519a5ea79c39d6738f39938ad0bde8cfda325a"} Jul 16 00:57:13.188434 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:13.188381 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" podStartSLOduration=0.963709803 podStartE2EDuration="1.188366197s" totalImagesPullingTime="224.656394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:57:13.187109237 +0000 UTC m=+781.710180508" watchObservedRunningTime="2026-07-16 00:57:13.188366197 +0000 UTC m=+781.711437452" Jul 16 00:57:22.513221 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:22.513185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:22.513702 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:22.513258 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:22.525692 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:22.525657 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:57:23.233789 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:57:23.233757 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2gvmv" Jul 16 00:59:11.903576 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:59:11.903498 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 00:59:11.904766 ip-10-0-142-151 kubenswrapper[2567]: I0716 00:59:11.904742 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:00:11.260984 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.260945 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-zdtqq"] Jul 16 01:00:11.261565 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.261146 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" podUID="9e850645-3f0e-46db-8112-505114c3abcc" containerName="manager" containerID="cri-o://82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd" gracePeriod=30 Jul 16 01:00:11.518127 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.518053 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 01:00:11.623267 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.623234 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e850645-3f0e-46db-8112-505114c3abcc-webhook-cert\") pod \"9e850645-3f0e-46db-8112-505114c3abcc\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " Jul 16 01:00:11.623445 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.623304 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm6ms\" (UniqueName: \"kubernetes.io/projected/9e850645-3f0e-46db-8112-505114c3abcc-kube-api-access-lm6ms\") pod \"9e850645-3f0e-46db-8112-505114c3abcc\" (UID: \"9e850645-3f0e-46db-8112-505114c3abcc\") " Jul 16 01:00:11.625451 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.625424 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e850645-3f0e-46db-8112-505114c3abcc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9e850645-3f0e-46db-8112-505114c3abcc" (UID: "9e850645-3f0e-46db-8112-505114c3abcc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 01:00:11.625542 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.625427 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e850645-3f0e-46db-8112-505114c3abcc-kube-api-access-lm6ms" (OuterVolumeSpecName: "kube-api-access-lm6ms") pod "9e850645-3f0e-46db-8112-505114c3abcc" (UID: "9e850645-3f0e-46db-8112-505114c3abcc"). InnerVolumeSpecName "kube-api-access-lm6ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:00:11.724325 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.724297 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e850645-3f0e-46db-8112-505114c3abcc-webhook-cert\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 01:00:11.724325 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:11.724323 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm6ms\" (UniqueName: \"kubernetes.io/projected/9e850645-3f0e-46db-8112-505114c3abcc-kube-api-access-lm6ms\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 01:00:12.002014 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.001966 2567 generic.go:356] "Generic (PLEG): container finished" podID="9e850645-3f0e-46db-8112-505114c3abcc" containerID="82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd" exitCode=0 Jul 16 01:00:12.002153 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.002051 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" Jul 16 01:00:12.002153 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.002056 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" event={"ID":"9e850645-3f0e-46db-8112-505114c3abcc","Type":"ContainerDied","Data":"82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd"} Jul 16 01:00:12.002153 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.002108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d8bbbcf5-zdtqq" event={"ID":"9e850645-3f0e-46db-8112-505114c3abcc","Type":"ContainerDied","Data":"b85e5ecd760c9c65a6f4876789fd3a30d8fc46ce1aad68e38850ee4bfc031468"} Jul 16 01:00:12.002153 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.002131 2567 scope.go:117] "RemoveContainer" containerID="82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd" Jul 16 01:00:12.010682 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.010664 2567 scope.go:117] "RemoveContainer" containerID="82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd" Jul 16 01:00:12.010961 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:00:12.010940 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd\": container with ID starting with 82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd not found: ID does not exist" containerID="82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd" Jul 16 01:00:12.011058 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.010969 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd"} err="failed to get container status \"82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd\": rpc error: code = NotFound desc = could not find container \"82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd\": container with ID starting with 82b7e075739a44faa164faf18d25ed16c938c37f7fe03228d0d5816e5d9844cd not found: ID does not exist" Jul 16 01:00:12.019173 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.019150 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-zdtqq"] Jul 16 01:00:12.023420 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.023400 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-zdtqq"] Jul 16 01:00:12.793159 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.793122 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-xrbl8"] Jul 16 01:00:12.793661 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.793642 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e850645-3f0e-46db-8112-505114c3abcc" containerName="manager" Jul 16 01:00:12.793743 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.793664 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e850645-3f0e-46db-8112-505114c3abcc" containerName="manager" Jul 16 01:00:12.793811 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.793797 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e850645-3f0e-46db-8112-505114c3abcc" containerName="manager" Jul 16 01:00:12.798048 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.798027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:12.801365 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.801339 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s52s6\"" Jul 16 01:00:12.801365 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.801357 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 01:00:12.801550 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.801359 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 01:00:12.806962 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.806940 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-xrbl8"] Jul 16 01:00:12.834768 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.834740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b21858f-1fd0-478e-bc88-04685cf378b0-webhook-cert\") pod \"maas-controller-68d8bbbcf5-xrbl8\" (UID: \"3b21858f-1fd0-478e-bc88-04685cf378b0\") " pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:12.834913 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.834804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqc9f\" (UniqueName: \"kubernetes.io/projected/3b21858f-1fd0-478e-bc88-04685cf378b0-kube-api-access-hqc9f\") pod \"maas-controller-68d8bbbcf5-xrbl8\" (UID: \"3b21858f-1fd0-478e-bc88-04685cf378b0\") " pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:12.936234 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.936194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b21858f-1fd0-478e-bc88-04685cf378b0-webhook-cert\") pod \"maas-controller-68d8bbbcf5-xrbl8\" (UID: \"3b21858f-1fd0-478e-bc88-04685cf378b0\") " pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:12.936400 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.936254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqc9f\" (UniqueName: \"kubernetes.io/projected/3b21858f-1fd0-478e-bc88-04685cf378b0-kube-api-access-hqc9f\") pod \"maas-controller-68d8bbbcf5-xrbl8\" (UID: \"3b21858f-1fd0-478e-bc88-04685cf378b0\") " pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:12.938728 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.938704 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b21858f-1fd0-478e-bc88-04685cf378b0-webhook-cert\") pod \"maas-controller-68d8bbbcf5-xrbl8\" (UID: \"3b21858f-1fd0-478e-bc88-04685cf378b0\") " pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:12.945422 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:12.945399 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqc9f\" (UniqueName: \"kubernetes.io/projected/3b21858f-1fd0-478e-bc88-04685cf378b0-kube-api-access-hqc9f\") pod \"maas-controller-68d8bbbcf5-xrbl8\" (UID: \"3b21858f-1fd0-478e-bc88-04685cf378b0\") " pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:13.109546 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:13.109502 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:13.242967 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:13.242944 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d8bbbcf5-xrbl8"] Jul 16 01:00:13.245152 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:00:13.245123 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b21858f_1fd0_478e_bc88_04685cf378b0.slice/crio-20e6ad183b540dea837e2f64917019e376263511e2d63398c594db1356586c0b WatchSource:0}: Error finding container 20e6ad183b540dea837e2f64917019e376263511e2d63398c594db1356586c0b: Status 404 returned error can't find the container with id 20e6ad183b540dea837e2f64917019e376263511e2d63398c594db1356586c0b Jul 16 01:00:13.246587 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:13.246565 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:00:13.972387 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:13.972354 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e850645-3f0e-46db-8112-505114c3abcc" path="/var/lib/kubelet/pods/9e850645-3f0e-46db-8112-505114c3abcc/volumes" Jul 16 01:00:14.014225 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:14.014140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" event={"ID":"3b21858f-1fd0-478e-bc88-04685cf378b0","Type":"ContainerStarted","Data":"cebf11993f6a5646d17a339b0e9c54a03ad68fbc4e801b15d18ef0d674d8fe1c"} Jul 16 01:00:14.014225 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:14.014190 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" event={"ID":"3b21858f-1fd0-478e-bc88-04685cf378b0","Type":"ContainerStarted","Data":"20e6ad183b540dea837e2f64917019e376263511e2d63398c594db1356586c0b"} Jul 16 01:00:14.014225 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:14.014215 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:00:14.032523 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:14.032467 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" podStartSLOduration=1.5339191840000002 podStartE2EDuration="2.032451026s" totalImagesPullingTime="498.531842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:00:14.031954915 +0000 UTC m=+962.555026169" watchObservedRunningTime="2026-07-16 01:00:14.032451026 +0000 UTC m=+962.555522281" Jul 16 01:00:25.020858 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:00:25.020825 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d8bbbcf5-xrbl8" Jul 16 01:04:11.933857 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:04:11.933829 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:04:11.935962 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:04:11.935929 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:09:11.963529 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:09:11.963499 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:09:11.965713 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:09:11.965692 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:12:31.268464 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.268434 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r"] Jul 16 01:12:31.272112 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.272094 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.274854 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.274836 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f9c9a9ad-serving-cert\"" Jul 16 01:12:31.283120 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.283067 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r"] Jul 16 01:12:31.402300 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.402265 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv48j\" (UniqueName: \"kubernetes.io/projected/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-kube-api-access-hv48j\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.402481 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.402326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-maas-api-tls\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.402481 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.402392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-openshift-service-ca\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.502968 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.502931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-maas-api-tls\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.503198 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.502983 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-openshift-service-ca\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.503198 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.503086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv48j\" (UniqueName: \"kubernetes.io/projected/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-kube-api-access-hv48j\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.503719 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.503698 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-openshift-service-ca\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.505560 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.505530 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-maas-api-tls\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.511884 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.511864 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv48j\" (UniqueName: \"kubernetes.io/projected/d20aa99a-9f9c-42c6-99d6-c49e8ecf5645-kube-api-access-hv48j\") pod \"maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r\" (UID: \"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.583019 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.582901 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:31.715846 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.715822 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r"] Jul 16 01:12:31.718099 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:12:31.718064 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20aa99a_9f9c_42c6_99d6_c49e8ecf5645.slice/crio-2b7bd15d501e7453242e44fb6a384c5b38b3b26c93c755e382918df146c3379b WatchSource:0}: Error finding container 2b7bd15d501e7453242e44fb6a384c5b38b3b26c93c755e382918df146c3379b: Status 404 returned error can't find the container with id 2b7bd15d501e7453242e44fb6a384c5b38b3b26c93c755e382918df146c3379b Jul 16 01:12:31.719374 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:31.719354 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:12:32.478599 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:32.478487 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" event={"ID":"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645","Type":"ContainerStarted","Data":"1b9e18b3ee66696766b8cebdc0b67a79820979bf77b4f51415a47b150638c133"} Jul 16 01:12:32.478599 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:32.478536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" event={"ID":"d20aa99a-9f9c-42c6-99d6-c49e8ecf5645","Type":"ContainerStarted","Data":"2b7bd15d501e7453242e44fb6a384c5b38b3b26c93c755e382918df146c3379b"} Jul 16 01:12:32.479035 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:32.478611 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:32.497435 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:32.497388 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" podStartSLOduration=1.001028757 podStartE2EDuration="1.497373591s" totalImagesPullingTime="496.344834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:32.496380218 +0000 UTC m=+1701.019451477" watchObservedRunningTime="2026-07-16 01:12:32.497373591 +0000 UTC m=+1701.020444848" Jul 16 01:12:38.488940 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:38.488906 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r" Jul 16 01:12:44.452720 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.452640 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm"] Jul 16 01:12:44.456239 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.456222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.458815 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.458788 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-389a944b-serving-cert\"" Jul 16 01:12:44.470505 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.470480 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm"] Jul 16 01:12:44.522364 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.522326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjq6n\" (UniqueName: \"kubernetes.io/projected/f8731eef-0b92-4793-8def-787de3f93209-kube-api-access-mjq6n\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.522537 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.522375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8731eef-0b92-4793-8def-787de3f93209-maas-api-tls\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.522537 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.522440 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8731eef-0b92-4793-8def-787de3f93209-openshift-service-ca\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.623742 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.623698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjq6n\" (UniqueName: \"kubernetes.io/projected/f8731eef-0b92-4793-8def-787de3f93209-kube-api-access-mjq6n\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.623948 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.623769 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8731eef-0b92-4793-8def-787de3f93209-maas-api-tls\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.623948 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.623824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8731eef-0b92-4793-8def-787de3f93209-openshift-service-ca\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.623948 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:12:44.623915 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-serving-cert: secret "maas-api-e2e-migrate-389a944b-serving-cert" not found Jul 16 01:12:44.624207 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:12:44.624018 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8731eef-0b92-4793-8def-787de3f93209-maas-api-tls podName:f8731eef-0b92-4793-8def-787de3f93209 nodeName:}" failed. No retries permitted until 2026-07-16 01:12:45.123970876 +0000 UTC m=+1713.647042118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8731eef-0b92-4793-8def-787de3f93209-maas-api-tls") pod "maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" (UID: "f8731eef-0b92-4793-8def-787de3f93209") : secret "maas-api-e2e-migrate-389a944b-serving-cert" not found Jul 16 01:12:44.624612 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.624589 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8731eef-0b92-4793-8def-787de3f93209-openshift-service-ca\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:44.632971 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:44.632947 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjq6n\" (UniqueName: \"kubernetes.io/projected/f8731eef-0b92-4793-8def-787de3f93209-kube-api-access-mjq6n\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:45.129568 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:45.129533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8731eef-0b92-4793-8def-787de3f93209-maas-api-tls\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:45.132314 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:45.132286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8731eef-0b92-4793-8def-787de3f93209-maas-api-tls\") pod \"maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm\" (UID: \"f8731eef-0b92-4793-8def-787de3f93209\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:45.368550 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:45.368518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:45.508608 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:45.508583 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm"] Jul 16 01:12:45.510713 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:12:45.510687 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8731eef_0b92_4793_8def_787de3f93209.slice/crio-ec87c0d3e3dee065846743f9984bc64ac07cc8324f6f56cb01c4555caafb7e53 WatchSource:0}: Error finding container ec87c0d3e3dee065846743f9984bc64ac07cc8324f6f56cb01c4555caafb7e53: Status 404 returned error can't find the container with id ec87c0d3e3dee065846743f9984bc64ac07cc8324f6f56cb01c4555caafb7e53 Jul 16 01:12:45.540663 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:45.540631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" event={"ID":"f8731eef-0b92-4793-8def-787de3f93209","Type":"ContainerStarted","Data":"ec87c0d3e3dee065846743f9984bc64ac07cc8324f6f56cb01c4555caafb7e53"} Jul 16 01:12:46.547065 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:46.547030 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" event={"ID":"f8731eef-0b92-4793-8def-787de3f93209","Type":"ContainerStarted","Data":"dc6a3336fad02b27493cbf153041717a984e844a5deb44a40e1c8047091c8a4b"} Jul 16 01:12:46.547446 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:46.547161 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:46.566038 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:46.565963 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" podStartSLOduration=2.164644599 podStartE2EDuration="2.565946826s" totalImagesPullingTime="401.302227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:46.564117682 +0000 UTC m=+1715.087188958" watchObservedRunningTime="2026-07-16 01:12:46.565946826 +0000 UTC m=+1715.089018081" Jul 16 01:12:52.556966 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:52.556935 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm" Jul 16 01:12:56.667393 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.667355 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt"] Jul 16 01:12:56.671223 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.671202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.674493 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.674473 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f122a48d-serving-cert\"" Jul 16 01:12:56.683483 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.683430 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt"] Jul 16 01:12:56.734149 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.734117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9522d201-6234-406e-add4-af1642c3a9b4-openshift-service-ca\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.734313 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.734167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9522d201-6234-406e-add4-af1642c3a9b4-maas-api-tls\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.734313 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.734242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9vdl\" (UniqueName: \"kubernetes.io/projected/9522d201-6234-406e-add4-af1642c3a9b4-kube-api-access-l9vdl\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.835339 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.835301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9522d201-6234-406e-add4-af1642c3a9b4-maas-api-tls\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.835498 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.835356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9vdl\" (UniqueName: \"kubernetes.io/projected/9522d201-6234-406e-add4-af1642c3a9b4-kube-api-access-l9vdl\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.835498 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.835412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9522d201-6234-406e-add4-af1642c3a9b4-openshift-service-ca\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.836034 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.835985 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9522d201-6234-406e-add4-af1642c3a9b4-openshift-service-ca\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.837809 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.837790 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9522d201-6234-406e-add4-af1642c3a9b4-maas-api-tls\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.845183 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.845158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9vdl\" (UniqueName: \"kubernetes.io/projected/9522d201-6234-406e-add4-af1642c3a9b4-kube-api-access-l9vdl\") pod \"maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt\" (UID: \"9522d201-6234-406e-add4-af1642c3a9b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:56.982607 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:56.982527 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:57.129373 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:57.129248 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt"] Jul 16 01:12:57.131775 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:12:57.131747 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9522d201_6234_406e_add4_af1642c3a9b4.slice/crio-83c1908669934c3b191ee2fef8914a3e5c3c3523e17701ad8c7e5af61425ab83 WatchSource:0}: Error finding container 83c1908669934c3b191ee2fef8914a3e5c3c3523e17701ad8c7e5af61425ab83: Status 404 returned error can't find the container with id 83c1908669934c3b191ee2fef8914a3e5c3c3523e17701ad8c7e5af61425ab83 Jul 16 01:12:57.599641 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:57.599603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" event={"ID":"9522d201-6234-406e-add4-af1642c3a9b4","Type":"ContainerStarted","Data":"dd5cb362e52c90b360d417773e3cd1332b77950d84f18ed36c5b46e69ab478c5"} Jul 16 01:12:57.599842 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:57.599660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" event={"ID":"9522d201-6234-406e-add4-af1642c3a9b4","Type":"ContainerStarted","Data":"83c1908669934c3b191ee2fef8914a3e5c3c3523e17701ad8c7e5af61425ab83"} Jul 16 01:12:57.599842 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:57.599701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:12:57.619069 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:12:57.619019 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" podStartSLOduration=1.268215339 podStartE2EDuration="1.618982004s" totalImagesPullingTime="350.766665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:12:57.616864749 +0000 UTC m=+1726.139936078" watchObservedRunningTime="2026-07-16 01:12:57.618982004 +0000 UTC m=+1726.142053259" Jul 16 01:13:03.609674 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:13:03.609647 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt" Jul 16 01:14:11.994198 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:11.994170 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:14:11.996537 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:11.996516 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:14:48.048086 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.048052 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7"] Jul 16 01:14:48.051717 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.051696 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.056221 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.056199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-54ada037-serving-cert\"" Jul 16 01:14:48.058580 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.058285 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62adbdf9-4bef-4a15-94d0-69f11c96380c-openshift-service-ca\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.058580 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.058337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhxz4\" (UniqueName: \"kubernetes.io/projected/62adbdf9-4bef-4a15-94d0-69f11c96380c-kube-api-access-bhxz4\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.058580 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.058465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.071670 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.071645 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7"] Jul 16 01:14:48.159054 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.159018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.159231 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.159076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62adbdf9-4bef-4a15-94d0-69f11c96380c-openshift-service-ca\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.159231 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.159103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhxz4\" (UniqueName: \"kubernetes.io/projected/62adbdf9-4bef-4a15-94d0-69f11c96380c-kube-api-access-bhxz4\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.159231 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:14:48.159178 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-serving-cert: secret "maas-api-e2e-mt-54ada037-serving-cert" not found Jul 16 01:14:48.159366 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:14:48.159234 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls podName:62adbdf9-4bef-4a15-94d0-69f11c96380c nodeName:}" failed. No retries permitted until 2026-07-16 01:14:48.659219115 +0000 UTC m=+1837.182290351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls") pod "maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" (UID: "62adbdf9-4bef-4a15-94d0-69f11c96380c") : secret "maas-api-e2e-mt-54ada037-serving-cert" not found Jul 16 01:14:48.159797 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.159774 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62adbdf9-4bef-4a15-94d0-69f11c96380c-openshift-service-ca\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.170957 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.170935 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhxz4\" (UniqueName: \"kubernetes.io/projected/62adbdf9-4bef-4a15-94d0-69f11c96380c-kube-api-access-bhxz4\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.661762 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:48.661727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:48.661949 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:14:48.661865 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-serving-cert: secret "maas-api-e2e-mt-54ada037-serving-cert" not found Jul 16 01:14:48.661949 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:14:48.661925 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls podName:62adbdf9-4bef-4a15-94d0-69f11c96380c nodeName:}" failed. No retries permitted until 2026-07-16 01:14:49.661908686 +0000 UTC m=+1838.184979924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls") pod "maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" (UID: "62adbdf9-4bef-4a15-94d0-69f11c96380c") : secret "maas-api-e2e-mt-54ada037-serving-cert" not found Jul 16 01:14:49.669448 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:49.669414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:49.671911 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:49.671892 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62adbdf9-4bef-4a15-94d0-69f11c96380c-maas-api-tls\") pod \"maas-api-e2e-mt-54ada037-9794bbbdf-dcth7\" (UID: \"62adbdf9-4bef-4a15-94d0-69f11c96380c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:49.862455 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:49.862414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:50.002064 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:50.002031 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7"] Jul 16 01:14:50.004171 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:14:50.004146 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62adbdf9_4bef_4a15_94d0_69f11c96380c.slice/crio-4f666570536989c1de70cfbb08fca53ad80ba934c2060f4e605b2a16867b78f5 WatchSource:0}: Error finding container 4f666570536989c1de70cfbb08fca53ad80ba934c2060f4e605b2a16867b78f5: Status 404 returned error can't find the container with id 4f666570536989c1de70cfbb08fca53ad80ba934c2060f4e605b2a16867b78f5 Jul 16 01:14:50.160374 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:50.160338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" event={"ID":"62adbdf9-4bef-4a15-94d0-69f11c96380c","Type":"ContainerStarted","Data":"4f666570536989c1de70cfbb08fca53ad80ba934c2060f4e605b2a16867b78f5"} Jul 16 01:14:51.166490 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:51.166456 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" event={"ID":"62adbdf9-4bef-4a15-94d0-69f11c96380c","Type":"ContainerStarted","Data":"41315fb83b76ae0636674a7706abe0d1686c15fe267418c4369439110b7a7310"} Jul 16 01:14:51.166901 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:51.166577 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:14:51.185906 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:51.185847 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" podStartSLOduration=2.766633317 podStartE2EDuration="3.185827854s" totalImagesPullingTime="419.194537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:14:51.184392663 +0000 UTC m=+1839.707463938" watchObservedRunningTime="2026-07-16 01:14:51.185827854 +0000 UTC m=+1839.708899109" Jul 16 01:14:57.176814 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:14:57.176782 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54ada037-9794bbbdf-dcth7" Jul 16 01:16:24.412510 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.412474 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4"] Jul 16 01:16:24.416144 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.416127 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.419031 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.418980 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-53347c-serving-cert\"" Jul 16 01:16:24.426543 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.426517 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4"] Jul 16 01:16:24.445840 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.445808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31547251-9dfb-4543-8621-96f588bc36c9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.446058 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.445848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31547251-9dfb-4543-8621-96f588bc36c9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.446058 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.445898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7zb\" (UniqueName: \"kubernetes.io/projected/31547251-9dfb-4543-8621-96f588bc36c9-kube-api-access-5v7zb\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.547262 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.547224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7zb\" (UniqueName: \"kubernetes.io/projected/31547251-9dfb-4543-8621-96f588bc36c9-kube-api-access-5v7zb\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.547435 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.547324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31547251-9dfb-4543-8621-96f588bc36c9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.547435 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.547341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31547251-9dfb-4543-8621-96f588bc36c9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.547956 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.547925 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31547251-9dfb-4543-8621-96f588bc36c9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.549963 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.549936 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31547251-9dfb-4543-8621-96f588bc36c9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.556963 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.556941 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7zb\" (UniqueName: \"kubernetes.io/projected/31547251-9dfb-4543-8621-96f588bc36c9-kube-api-access-5v7zb\") pod \"maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4\" (UID: \"31547251-9dfb-4543-8621-96f588bc36c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.727375 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.727299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:24.865191 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:24.865169 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4"] Jul 16 01:16:24.867682 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:16:24.867655 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31547251_9dfb_4543_8621_96f588bc36c9.slice/crio-d9acd896251c80410ff09880b201d30e85fbaed49513a2f5780978753c198be4 WatchSource:0}: Error finding container d9acd896251c80410ff09880b201d30e85fbaed49513a2f5780978753c198be4: Status 404 returned error can't find the container with id d9acd896251c80410ff09880b201d30e85fbaed49513a2f5780978753c198be4 Jul 16 01:16:25.638978 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:25.638872 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" event={"ID":"31547251-9dfb-4543-8621-96f588bc36c9","Type":"ContainerStarted","Data":"5b789a8a065630a7a5471729d160156baeb340613c21bc9579d4208985ed4abb"} Jul 16 01:16:25.638978 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:25.638962 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" event={"ID":"31547251-9dfb-4543-8621-96f588bc36c9","Type":"ContainerStarted","Data":"d9acd896251c80410ff09880b201d30e85fbaed49513a2f5780978753c198be4"} Jul 16 01:16:25.639461 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:25.639019 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:31.650939 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:31.650896 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" Jul 16 01:16:31.670244 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:31.670194 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4" podStartSLOduration=7.179398454 podStartE2EDuration="7.670178529s" totalImagesPullingTime="490.780075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:16:25.656563091 +0000 UTC m=+1934.179634337" watchObservedRunningTime="2026-07-16 01:16:31.670178529 +0000 UTC m=+1940.193249822" Jul 16 01:16:32.571192 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.571158 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4"] Jul 16 01:16:32.575524 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.575496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.578005 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.577967 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-640a35-serving-cert\"" Jul 16 01:16:32.584627 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.584593 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4"] Jul 16 01:16:32.623521 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.623482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8sz\" (UniqueName: \"kubernetes.io/projected/4d30bac2-0b55-469d-8161-0a9bb180631b-kube-api-access-kf8sz\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.623669 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.623545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d30bac2-0b55-469d-8161-0a9bb180631b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.623736 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.623666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d30bac2-0b55-469d-8161-0a9bb180631b-maas-api-tls\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.724754 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.724714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d30bac2-0b55-469d-8161-0a9bb180631b-maas-api-tls\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.725265 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.724773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8sz\" (UniqueName: \"kubernetes.io/projected/4d30bac2-0b55-469d-8161-0a9bb180631b-kube-api-access-kf8sz\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.725265 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.724804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d30bac2-0b55-469d-8161-0a9bb180631b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.725265 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:16:32.724904 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-serving-cert: secret "maas-api-e2e-inf-b-640a35-serving-cert" not found Jul 16 01:16:32.725265 ip-10-0-142-151 kubenswrapper[2567]: E0716 01:16:32.725025 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30bac2-0b55-469d-8161-0a9bb180631b-maas-api-tls podName:4d30bac2-0b55-469d-8161-0a9bb180631b nodeName:}" failed. No retries permitted until 2026-07-16 01:16:33.224974383 +0000 UTC m=+1941.748045628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d30bac2-0b55-469d-8161-0a9bb180631b-maas-api-tls") pod "maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" (UID: "4d30bac2-0b55-469d-8161-0a9bb180631b") : secret "maas-api-e2e-inf-b-640a35-serving-cert" not found Jul 16 01:16:32.725443 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.725424 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d30bac2-0b55-469d-8161-0a9bb180631b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:32.735906 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:32.735884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8sz\" (UniqueName: \"kubernetes.io/projected/4d30bac2-0b55-469d-8161-0a9bb180631b-kube-api-access-kf8sz\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:33.230139 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:33.230105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d30bac2-0b55-469d-8161-0a9bb180631b-maas-api-tls\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:33.232786 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:33.232764 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d30bac2-0b55-469d-8161-0a9bb180631b-maas-api-tls\") pod \"maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4\" (UID: \"4d30bac2-0b55-469d-8161-0a9bb180631b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:33.488841 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:33.488767 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:33.629384 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:33.629356 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4"] Jul 16 01:16:33.631663 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:16:33.631637 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d30bac2_0b55_469d_8161_0a9bb180631b.slice/crio-6d0b5add32ced1acabf5488f9ee727a0a4d2fe3b4c1e260908175a5c10b21f73 WatchSource:0}: Error finding container 6d0b5add32ced1acabf5488f9ee727a0a4d2fe3b4c1e260908175a5c10b21f73: Status 404 returned error can't find the container with id 6d0b5add32ced1acabf5488f9ee727a0a4d2fe3b4c1e260908175a5c10b21f73 Jul 16 01:16:33.677407 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:33.677372 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" event={"ID":"4d30bac2-0b55-469d-8161-0a9bb180631b","Type":"ContainerStarted","Data":"6d0b5add32ced1acabf5488f9ee727a0a4d2fe3b4c1e260908175a5c10b21f73"} Jul 16 01:16:34.686893 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:34.686855 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" event={"ID":"4d30bac2-0b55-469d-8161-0a9bb180631b","Type":"ContainerStarted","Data":"e385803c264b18584c7c70a833a5d58620cd306f213439edc5b07a561540fb4d"} Jul 16 01:16:34.687343 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:34.686971 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:16:34.705090 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:34.705046 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" podStartSLOduration=2.323266278 podStartE2EDuration="2.705029288s" totalImagesPullingTime="381.76301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:16:34.704659752 +0000 UTC m=+1943.227731012" watchObservedRunningTime="2026-07-16 01:16:34.705029288 +0000 UTC m=+1943.228100543" Jul 16 01:16:40.697772 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:16:40.697743 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4" Jul 16 01:19:12.027648 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:19:12.027611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:19:12.031602 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:19:12.031582 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:24:12.058602 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:24:12.058574 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:24:12.063553 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:24:12.063535 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xjs85_a6c3e6b4-3841-4609-b6f5-4dee9796eeb7/ovn-acl-logging/0.log" Jul 16 01:26:04.428406 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.428323 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7348-139786015544112"] Jul 16 01:26:04.431964 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.431944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:04.434522 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.434502 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wtk8p\"" Jul 16 01:26:04.440265 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.440244 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786015544112"] Jul 16 01:26:04.558731 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.558690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzdx\" (UniqueName: \"kubernetes.io/projected/c50664b9-86e9-4963-bd5b-d0981795e523-kube-api-access-cnzdx\") pod \"test-curl-7348-139786015544112\" (UID: \"c50664b9-86e9-4963-bd5b-d0981795e523\") " pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:04.660087 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.660046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzdx\" (UniqueName: \"kubernetes.io/projected/c50664b9-86e9-4963-bd5b-d0981795e523-kube-api-access-cnzdx\") pod \"test-curl-7348-139786015544112\" (UID: \"c50664b9-86e9-4963-bd5b-d0981795e523\") " pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:04.669257 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.669228 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzdx\" (UniqueName: \"kubernetes.io/projected/c50664b9-86e9-4963-bd5b-d0981795e523-kube-api-access-cnzdx\") pod \"test-curl-7348-139786015544112\" (UID: \"c50664b9-86e9-4963-bd5b-d0981795e523\") " pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:04.741818 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.741746 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:04.877465 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.877430 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786015544112"] Jul 16 01:26:04.880673 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:26:04.880647 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc50664b9_86e9_4963_bd5b_d0981795e523.slice/crio-8b2de4d0605cb701439673a6b260a9df6818df6904ff5b457be22f0f373a2da0 WatchSource:0}: Error finding container 8b2de4d0605cb701439673a6b260a9df6818df6904ff5b457be22f0f373a2da0: Status 404 returned error can't find the container with id 8b2de4d0605cb701439673a6b260a9df6818df6904ff5b457be22f0f373a2da0 Jul 16 01:26:04.882313 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:04.882292 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:26:05.521250 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:05.521210 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786015544112" event={"ID":"c50664b9-86e9-4963-bd5b-d0981795e523","Type":"ContainerStarted","Data":"8b2de4d0605cb701439673a6b260a9df6818df6904ff5b457be22f0f373a2da0"} Jul 16 01:26:06.533969 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:06.533933 2567 generic.go:356] "Generic (PLEG): container finished" podID="c50664b9-86e9-4963-bd5b-d0981795e523" containerID="54dd8f337d61b4947cd33d940385541c9bbb9a821b62bf83d2d587ea5c6c12cf" exitCode=0 Jul 16 01:26:06.534366 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:06.534031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786015544112" event={"ID":"c50664b9-86e9-4963-bd5b-d0981795e523","Type":"ContainerDied","Data":"54dd8f337d61b4947cd33d940385541c9bbb9a821b62bf83d2d587ea5c6c12cf"} Jul 16 01:26:07.677955 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.677916 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:07.687376 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.687355 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnzdx\" (UniqueName: \"kubernetes.io/projected/c50664b9-86e9-4963-bd5b-d0981795e523-kube-api-access-cnzdx\") pod \"c50664b9-86e9-4963-bd5b-d0981795e523\" (UID: \"c50664b9-86e9-4963-bd5b-d0981795e523\") " Jul 16 01:26:07.689490 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.689467 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c50664b9-86e9-4963-bd5b-d0981795e523-kube-api-access-cnzdx" (OuterVolumeSpecName: "kube-api-access-cnzdx") pod "c50664b9-86e9-4963-bd5b-d0981795e523" (UID: "c50664b9-86e9-4963-bd5b-d0981795e523"). InnerVolumeSpecName "kube-api-access-cnzdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:26:07.719005 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.718955 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7348-139786015544112_c50664b9-86e9-4963-bd5b-d0981795e523/test-curl-7348-139786015544112/0.log" Jul 16 01:26:07.744964 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.744934 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7348-139786015544112"] Jul 16 01:26:07.754534 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.754510 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7348-139786015544112"] Jul 16 01:26:07.788135 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.788104 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnzdx\" (UniqueName: \"kubernetes.io/projected/c50664b9-86e9-4963-bd5b-d0981795e523-kube-api-access-cnzdx\") on node \"ip-10-0-142-151.ec2.internal\" DevicePath \"\"" Jul 16 01:26:07.973546 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:07.973507 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c50664b9-86e9-4963-bd5b-d0981795e523" path="/var/lib/kubelet/pods/c50664b9-86e9-4963-bd5b-d0981795e523/volumes" Jul 16 01:26:08.545355 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:08.545328 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786015544112" Jul 16 01:26:08.545538 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:08.545382 2567 scope.go:117] "RemoveContainer" containerID="54dd8f337d61b4947cd33d940385541c9bbb9a821b62bf83d2d587ea5c6c12cf" Jul 16 01:26:39.498939 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:39.498897 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d8bbbcf5-xrbl8_3b21858f-1fd0-478e-bc88-04685cf378b0/manager/0.log" Jul 16 01:26:39.977744 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:39.977718 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-cc86f_a3ec458c-3cd1-4814-9f17-69ac133c3368/manager/0.log" Jul 16 01:26:39.984763 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:39.984740 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-cc86f_a3ec458c-3cd1-4814-9f17-69ac133c3368/copy-manifests/0.log" Jul 16 01:26:40.479052 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:40.479004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-767bf5db7b-pfvdp_41408982-30ae-4f55-8cd0-53d5b7f05f44/maas-api/0.log" Jul 16 01:26:40.595115 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:40.595077 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-f9c9a9ad-988c4db6f-9g57r_d20aa99a-9f9c-42c6-99d6-c49e8ecf5645/maas-api/0.log" Jul 16 01:26:40.958827 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:40.958788 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-f122a48d-56b4f59f64-bzmqt_9522d201-6234-406e-add4-af1642c3a9b4/maas-api/0.log" Jul 16 01:26:41.082565 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:41.082541 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-53347c-57d4bc8f95-dx2q4_31547251-9dfb-4543-8621-96f588bc36c9/maas-api/0.log" Jul 16 01:26:41.202238 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:41.202204 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-640a35-847c8f866d-b9zb4_4d30bac2-0b55-469d-8161-0a9bb180631b/maas-api/0.log" Jul 16 01:26:41.323261 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:41.323185 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-389a944b-544d7cdb4d-p6szm_f8731eef-0b92-4793-8def-787de3f93209/maas-api/0.log" Jul 16 01:26:41.445237 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:41.445203 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-54ada037-9794bbbdf-dcth7_62adbdf9-4bef-4a15-94d0-69f11c96380c/maas-api/0.log" Jul 16 01:26:42.473343 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:42.473311 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5szqj_a8f27ef0-0cbc-458e-936c-e65fecd1ed05/postgres/0.log" Jul 16 01:26:44.019916 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:44.019888 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9dwht_1dec5d4c-e8e6-45d0-8392-351adb47af22/manager/0.log" Jul 16 01:26:44.139331 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:44.139301 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5czpk_d8630021-3136-452f-a238-c68eb41d8843/kuadrant-console-plugin/0.log" Jul 16 01:26:45.329654 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:45.329628 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-vktkp_91654066-a762-4b4c-a652-66bb6c118792/kube-auth-proxy/0.log" Jul 16 01:26:45.576747 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:45.576694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4qj5j_7f30f8b5-2af7-4b6d-b010-df624539e68e/payload-pre-processing/0.log" Jul 16 01:26:45.694827 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:45.694796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x5m47_2942b407-a7ef-456d-8fcd-9759f6fac878/payload-processing/0.log" Jul 16 01:26:46.146591 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:46.146557 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mjdk4_19fe0d59-86eb-4550-85ca-c6d6ba8bfea3/main/0.log" Jul 16 01:26:46.264387 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:46.264360 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2gvmv_9e5b2ee1-db9b-4ffd-8fd1-ef8b750e2367/main/0.log" Jul 16 01:26:55.587017 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:55.586972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w59jq_f149c855-2cbf-4457-8785-3f1da93eeeac/global-pull-secret-syncer/0.log" Jul 16 01:26:55.717209 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:55.717175 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sh2n5_27e5f646-a91c-40ac-a498-bcbcb5951df8/konnectivity-agent/0.log" Jul 16 01:26:55.763311 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:26:55.763278 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-151.ec2.internal_f9c2d3e118248939805a7aa39f3081f8/haproxy/0.log" Jul 16 01:27:01.227136 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:01.227110 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9dwht_1dec5d4c-e8e6-45d0-8392-351adb47af22/manager/0.log" Jul 16 01:27:01.256972 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:01.256942 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5czpk_d8630021-3136-452f-a238-c68eb41d8843/kuadrant-console-plugin/0.log" Jul 16 01:27:03.101683 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.101647 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/alertmanager/0.log" Jul 16 01:27:03.122616 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.122593 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/config-reloader/0.log" Jul 16 01:27:03.146192 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.146165 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/kube-rbac-proxy-web/0.log" Jul 16 01:27:03.183085 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.183056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/kube-rbac-proxy/0.log" Jul 16 01:27:03.205478 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.205452 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/kube-rbac-proxy-metric/0.log" Jul 16 01:27:03.227935 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.227849 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/prom-label-proxy/0.log" Jul 16 01:27:03.259066 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.259030 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d278c0be-7f0f-40f0-92f5-5f4a057a61e5/init-config-reloader/0.log" Jul 16 01:27:03.309123 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.309090 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9rnzl_2ee9bc73-ab95-47cc-94ca-385dcf41b26c/cluster-monitoring-operator/0.log" Jul 16 01:27:03.443236 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.443187 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-675bb5bfd8-tjdgn_5c54cb63-5976-4b60-ada2-18a0bd6e555d/metrics-server/0.log" Jul 16 01:27:03.573309 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.573230 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fp87d_b1263bb4-3619-47d8-be60-ee7d11dae8fa/node-exporter/0.log" Jul 16 01:27:03.594420 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.594395 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fp87d_b1263bb4-3619-47d8-be60-ee7d11dae8fa/kube-rbac-proxy/0.log" Jul 16 01:27:03.622556 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.622533 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fp87d_b1263bb4-3619-47d8-be60-ee7d11dae8fa/init-textfile/0.log" Jul 16 01:27:03.836259 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.836150 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/prometheus/0.log" Jul 16 01:27:03.857447 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.857422 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/config-reloader/0.log" Jul 16 01:27:03.880135 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.880097 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/thanos-sidecar/0.log" Jul 16 01:27:03.905447 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.905415 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/kube-rbac-proxy-web/0.log" Jul 16 01:27:03.927134 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.927104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/kube-rbac-proxy/0.log" Jul 16 01:27:03.952691 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.952665 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/kube-rbac-proxy-thanos/0.log" Jul 16 01:27:03.977125 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:03.977084 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08244e1b-d8ec-47e1-b645-cb056f89b5bb/init-config-reloader/0.log" Jul 16 01:27:04.057466 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:04.057439 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-vhtkc_c3916993-bdc8-4174-9155-1661a56147db/prometheus-operator-admission-webhook/0.log" Jul 16 01:27:05.438300 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.438266 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-b9wzb_081b3ae8-51d3-47b8-8052-9756455f564f/networking-console-plugin/0.log" Jul 16 01:27:05.756117 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.756041 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56"] Jul 16 01:27:05.756485 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.756465 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50664b9-86e9-4963-bd5b-d0981795e523" containerName="test-curl-7348-139786015544112" Jul 16 01:27:05.756485 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.756486 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50664b9-86e9-4963-bd5b-d0981795e523" containerName="test-curl-7348-139786015544112" Jul 16 01:27:05.756677 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.756586 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c50664b9-86e9-4963-bd5b-d0981795e523" containerName="test-curl-7348-139786015544112" Jul 16 01:27:05.760232 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.760213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.762711 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.762695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld8p\"/\"kube-root-ca.crt\"" Jul 16 01:27:05.763082 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.763058 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld8p\"/\"openshift-service-ca.crt\"" Jul 16 01:27:05.764133 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.764113 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bld8p\"/\"default-dockercfg-smqpt\"" Jul 16 01:27:05.768529 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.768509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56"] Jul 16 01:27:05.840376 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.840340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-lib-modules\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.840558 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.840396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-sys\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.840558 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.840517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqbv\" (UniqueName: \"kubernetes.io/projected/1b194042-555d-47f1-9b96-af917f09d5df-kube-api-access-5fqbv\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.840558 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.840554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-podres\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.840677 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.840577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-proc\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941406 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqbv\" (UniqueName: \"kubernetes.io/projected/1b194042-555d-47f1-9b96-af917f09d5df-kube-api-access-5fqbv\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941587 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-podres\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941587 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-proc\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941587 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-lib-modules\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941587 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-sys\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941766 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941593 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-proc\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941766 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-podres\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941766 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941685 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-lib-modules\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.941766 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.941685 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b194042-555d-47f1-9b96-af917f09d5df-sys\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:05.949679 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:05.949651 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqbv\" (UniqueName: \"kubernetes.io/projected/1b194042-555d-47f1-9b96-af917f09d5df-kube-api-access-5fqbv\") pod \"perf-node-gather-daemonset-lln56\" (UID: \"1b194042-555d-47f1-9b96-af917f09d5df\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:06.071512 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:06.071429 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:06.211419 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:06.211393 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56"] Jul 16 01:27:06.213303 ip-10-0-142-151 kubenswrapper[2567]: W0716 01:27:06.213273 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b194042_555d_47f1_9b96_af917f09d5df.slice/crio-2051ddeea2ead68120b715b93e58496753a025d09a61e9e2f53aa139c20611f5 WatchSource:0}: Error finding container 2051ddeea2ead68120b715b93e58496753a025d09a61e9e2f53aa139c20611f5: Status 404 returned error can't find the container with id 2051ddeea2ead68120b715b93e58496753a025d09a61e9e2f53aa139c20611f5 Jul 16 01:27:06.828300 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:06.828258 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" event={"ID":"1b194042-555d-47f1-9b96-af917f09d5df","Type":"ContainerStarted","Data":"6344b6b47016d7ef724cf28e7d93b381193fc7d734c31ce0ffa37d8d1e6a6aa5"} Jul 16 01:27:06.828678 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:06.828326 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:06.828678 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:06.828345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" event={"ID":"1b194042-555d-47f1-9b96-af917f09d5df","Type":"ContainerStarted","Data":"2051ddeea2ead68120b715b93e58496753a025d09a61e9e2f53aa139c20611f5"} Jul 16 01:27:06.844937 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:06.844889 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" podStartSLOduration=1.844873303 podStartE2EDuration="1.844873303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 01:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:27:06.844360312 +0000 UTC m=+2575.367431568" watchObservedRunningTime="2026-07-16 01:27:06.844873303 +0000 UTC m=+2575.367944558" Jul 16 01:27:08.308396 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:08.308344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4qklq_d9e282ad-c750-4afe-8ae8-eec443f64bbe/dns/0.log" Jul 16 01:27:08.331912 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:08.331882 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4qklq_d9e282ad-c750-4afe-8ae8-eec443f64bbe/kube-rbac-proxy/0.log" Jul 16 01:27:08.497104 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:08.497070 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbqs6_dbd11bec-57fe-4279-ac17-c46468899f03/dns-node-resolver/0.log" Jul 16 01:27:09.100194 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:09.100162 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xf84j_bb06ec6e-d6ec-476e-840a-ffe9f0f709b9/node-ca/0.log" Jul 16 01:27:10.263393 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:10.263355 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-vktkp_91654066-a762-4b4c-a652-66bb6c118792/kube-auth-proxy/0.log" Jul 16 01:27:10.402109 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:10.402070 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4qj5j_7f30f8b5-2af7-4b6d-b010-df624539e68e/payload-pre-processing/0.log" Jul 16 01:27:10.444984 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:10.444954 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x5m47_2942b407-a7ef-456d-8fcd-9759f6fac878/payload-processing/0.log" Jul 16 01:27:11.191958 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:11.191930 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rf782_4fba8b81-6108-412d-a66e-776a8d7f7bbf/serve-healthcheck-canary/0.log" Jul 16 01:27:11.848049 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:11.848021 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vmk7q_1da5ddfa-1d35-46e1-80a4-11d20858e00f/kube-rbac-proxy/0.log" Jul 16 01:27:11.868924 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:11.868903 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vmk7q_1da5ddfa-1d35-46e1-80a4-11d20858e00f/exporter/0.log" Jul 16 01:27:11.889811 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:11.889776 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vmk7q_1da5ddfa-1d35-46e1-80a4-11d20858e00f/extractor/0.log" Jul 16 01:27:12.843863 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:12.843832 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-lln56" Jul 16 01:27:14.370515 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:14.370482 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d8bbbcf5-xrbl8_3b21858f-1fd0-478e-bc88-04685cf378b0/manager/0.log" Jul 16 01:27:14.584780 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:14.584749 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-cc86f_a3ec458c-3cd1-4814-9f17-69ac133c3368/manager/0.log" Jul 16 01:27:14.608302 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:14.608275 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-cc86f_a3ec458c-3cd1-4814-9f17-69ac133c3368/copy-manifests/0.log" Jul 16 01:27:16.246140 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:16.246046 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57c869f4fd-mktwj_8d99340a-8592-4ea8-8669-71356f98347a/manager/0.log" Jul 16 01:27:16.336362 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:16.336333 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-vktkp_91654066-a762-4b4c-a652-66bb6c118792/kube-auth-proxy/0.log" Jul 16 01:27:16.458892 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:16.458860 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4qj5j_7f30f8b5-2af7-4b6d-b010-df624539e68e/payload-pre-processing/0.log" Jul 16 01:27:16.491981 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:16.491951 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x5m47_2942b407-a7ef-456d-8fcd-9759f6fac878/payload-processing/0.log" Jul 16 01:27:17.913191 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:17.913163 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9949ccdc-vktkp_91654066-a762-4b4c-a652-66bb6c118792/kube-auth-proxy/0.log" Jul 16 01:27:18.033141 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:18.033110 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4qj5j_7f30f8b5-2af7-4b6d-b010-df624539e68e/payload-pre-processing/0.log" Jul 16 01:27:18.069367 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:18.069335 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-x5m47_2942b407-a7ef-456d-8fcd-9759f6fac878/payload-processing/0.log" Jul 16 01:27:21.347348 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:21.347313 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-txfrj_79949238-f5fd-4d66-beca-4975e978b2f3/migrator/0.log" Jul 16 01:27:21.369575 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:21.369545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-txfrj_79949238-f5fd-4d66-beca-4975e978b2f3/graceful-termination/0.log" Jul 16 01:27:23.020671 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:23.020642 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zbnr_1126c224-f332-4834-816a-5d8b196bb0dd/kube-multus-additional-cni-plugins/0.log" Jul 16 01:27:23.068652 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:23.068623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zbnr_1126c224-f332-4834-816a-5d8b196bb0dd/egress-router-binary-copy/0.log" Jul 16 01:27:23.115658 ip-10-0-142-151 kubenswrapper[2567]: I0716 01:27:23.115634 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zbnr_1126c224-f332-4834-816a-5d8b196bb0dd/cni-plugins/0.log"