Jul 15 15:24:03.477801 ip-10-0-140-61 systemd[1]: Starting Kubernetes Kubelet... Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.924994 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928513 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928528 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928532 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928536 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928538 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928541 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928544 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:24:03.963967 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928547 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928550 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928552 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928555 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928558 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928560 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928563 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928566 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928569 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928573 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928577 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928580 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928583 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928585 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928588 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928590 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928593 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928596 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928598 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928601 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:24:03.967270 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928604 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928607 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928609 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928613 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928615 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928618 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928621 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928624 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928626 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928630 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928633 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928635 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928638 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928642 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928646 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928649 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928652 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928654 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928657 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:24:03.971153 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928660 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928664 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928667 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928670 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928672 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928675 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928678 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928681 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928684 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928686 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928689 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928692 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928694 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928697 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928700 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928702 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928705 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928707 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928709 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928712 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:24:03.974047 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928714 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928717 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928720 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928722 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928725 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928727 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928729 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928732 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928734 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928737 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928739 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928742 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928744 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928747 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928750 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928752 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928754 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928757 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928760 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:24:03.978241 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928763 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928765 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928768 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928771 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928774 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928776 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928779 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928787 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928791 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928794 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928797 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928801 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928804 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.928807 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929621 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929636 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929640 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929644 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929647 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929651 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:24:03.981584 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929654 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929657 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929660 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929663 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929666 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929669 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929671 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929674 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929677 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929680 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929682 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929685 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929687 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929692 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929696 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929700 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929703 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929706 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929708 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929723 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:24:03.985624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929726 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929728 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929731 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929734 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929736 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929739 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929742 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929745 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929748 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929752 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929755 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929757 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929760 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929762 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929765 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929768 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929770 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929773 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929775 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929778 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:24:03.988553 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929781 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929783 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929786 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929788 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929794 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929797 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929801 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929805 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929808 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929811 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929814 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929825 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929828 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929831 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929834 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929837 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929843 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929845 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:24:03.992288 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929848 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929851 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929853 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929856 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929858 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929861 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929864 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929866 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929869 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929872 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929875 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929878 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929880 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929883 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929885 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929889 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929894 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929897 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929901 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929904 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:24:03.995230 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929907 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929910 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929913 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929916 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929918 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929923 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929932 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929935 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929938 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929943 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929946 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929949 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929957 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.929960 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930453 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930459 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930461 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930481 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930484 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930487 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:24:03.999438 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930490 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930493 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930495 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930498 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930500 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930503 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930506 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930509 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930512 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930514 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930517 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930521 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930524 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930527 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930530 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930533 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930536 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930539 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930547 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:24:04.002655 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930550 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930553 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930557 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930560 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930562 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930565 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930568 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930570 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930578 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930581 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930583 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930586 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930588 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930591 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930594 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930596 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930599 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930601 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930604 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930606 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:24:04.006359 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930609 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930621 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930625 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930628 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930631 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930634 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930636 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930639 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930641 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930644 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930647 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930649 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930657 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930660 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930664 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930667 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930669 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930672 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930675 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:24:04.009740 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930677 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:24:04.008154 ip-10-0-140-61 systemd[1]: Started Kubernetes Kubelet. Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930680 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930682 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930685 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930687 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930690 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930693 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930696 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930698 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930701 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930703 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930705 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930708 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930711 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930713 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930716 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930718 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930721 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930724 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930729 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:24:04.015204 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930732 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930736 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930739 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930741 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930744 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930746 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930755 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930759 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930762 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930765 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930767 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930770 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930772 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930775 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.930777 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930869 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930878 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930887 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930892 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930896 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930899 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930903 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 15:24:04.020641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930908 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930911 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930914 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930917 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930921 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930924 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930927 2578 flags.go:64] FLAG: --cgroup-root="" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930930 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930933 2578 flags.go:64] FLAG: --client-ca-file="" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930938 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930941 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930947 2578 flags.go:64] FLAG: --cluster-domain="" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930950 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930953 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930956 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930959 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930963 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930973 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930976 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930980 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930983 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930986 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930989 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930992 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 15:24:04.026440 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930995 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.930999 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931002 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931005 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931008 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931011 2578 flags.go:64] FLAG: --enable-server="true" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931014 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931021 2578 flags.go:64] FLAG: --event-burst="100" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931024 2578 flags.go:64] FLAG: --event-qps="50" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931027 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931030 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931033 2578 flags.go:64] FLAG: --eviction-hard="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931036 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931039 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931042 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931045 2578 flags.go:64] FLAG: --eviction-soft="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931048 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931052 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931055 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931058 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931061 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931064 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931067 2578 flags.go:64] FLAG: --feature-gates="" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931071 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931074 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 15:24:04.030210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931079 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931088 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931091 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931094 2578 flags.go:64] FLAG: --help="false" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931097 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-61.ec2.internal" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931100 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931103 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931106 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931110 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931113 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931116 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931119 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931122 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931124 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931127 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931131 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931134 2578 flags.go:64] FLAG: --kube-reserved="" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931137 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931139 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931142 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931145 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931148 2578 flags.go:64] FLAG: --lock-file="" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931150 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931153 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 15:24:04.035114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931158 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931164 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931167 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931170 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931173 2578 flags.go:64] FLAG: --logging-format="text" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931176 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931179 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931181 2578 flags.go:64] FLAG: --manifest-url="" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931186 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931191 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931199 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931204 2578 flags.go:64] FLAG: --max-pods="110" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931207 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931210 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931213 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931216 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931219 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931222 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931225 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931233 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931236 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931239 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931242 2578 flags.go:64] FLAG: --pod-cidr="" Jul 15 15:24:04.210289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931245 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931250 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931253 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931257 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931260 2578 flags.go:64] FLAG: --port="10250" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931263 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931266 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccc4198ff4d2f051" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931269 2578 flags.go:64] FLAG: --qos-reserved="" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931272 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931277 2578 flags.go:64] FLAG: --register-node="true" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931280 2578 flags.go:64] FLAG: --register-with-taints="" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931283 2578 flags.go:64] FLAG: --registry-burst="10" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931286 2578 flags.go:64] FLAG: --registry-qps="5" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931289 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931292 2578 flags.go:64] FLAG: --reserved-memory="" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931296 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931298 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931301 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931306 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931309 2578 flags.go:64] FLAG: --runonce="false" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931317 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931321 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931324 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931327 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931330 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931333 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 15:24:04.211948 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931337 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931340 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931342 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931345 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931348 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931351 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931354 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931357 2578 flags.go:64] FLAG: --system-cgroups="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931359 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931365 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931368 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931370 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931377 2578 flags.go:64] FLAG: --tls-min-version="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931379 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931382 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931387 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931390 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931393 2578 flags.go:64] FLAG: --v="2" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931396 2578 flags.go:64] FLAG: --version="false" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931400 2578 flags.go:64] FLAG: --vmodule="" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931404 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.931408 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931637 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931653 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:24:04.226988 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931658 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931661 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931664 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931672 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931675 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931678 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931681 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931684 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931687 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931690 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931692 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931695 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931699 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931703 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931707 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931710 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931712 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931715 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931717 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:24:04.277513 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931720 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931723 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931725 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931728 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931730 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931734 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931737 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931739 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931742 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931745 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931747 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931749 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931752 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931757 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931760 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931763 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931765 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931774 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931777 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931781 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:24:04.278456 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931784 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931787 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931789 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931792 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931795 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931797 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931800 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931803 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931805 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931808 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931811 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931813 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931816 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931818 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931820 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931823 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931826 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931830 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931833 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:24:04.279251 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931835 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931838 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931841 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931843 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931846 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931849 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931853 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931855 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931858 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931860 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931863 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931874 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931876 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931879 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931882 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931884 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931887 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931890 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931892 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:24:04.280227 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931895 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931898 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931900 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931903 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931906 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931908 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931911 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931914 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931917 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931919 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931922 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931926 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931928 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931931 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931933 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931936 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931939 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931941 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931944 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:24:04.281949 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.931948 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.932575 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.941984 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.942007 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.942033 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.942044 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942118 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942125 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942128 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942131 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942135 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942137 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942140 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942142 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:24:04.283687 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942145 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942148 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942152 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942155 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942157 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942160 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942162 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942165 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942168 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942171 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942173 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942176 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942179 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942181 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942184 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942186 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942189 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942191 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942195 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942197 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:24:04.284986 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942200 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942204 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942206 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942209 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942212 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942214 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942216 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942219 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942221 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942224 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942226 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942229 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942231 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942234 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942238 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942240 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942243 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942245 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942248 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942251 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:24:04.286366 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942253 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942256 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942259 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942261 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942264 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942267 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942271 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942274 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942277 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942280 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942283 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942286 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942288 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942292 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942296 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942298 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942301 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942303 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942306 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942309 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:24:04.288595 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942312 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942314 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942317 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942319 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942322 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942324 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942329 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942332 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942334 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942337 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942340 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942343 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942345 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942348 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942350 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942353 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942356 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942358 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942361 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:24:04.290794 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942363 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942367 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942370 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942374 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942378 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942382 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942387 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942390 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942393 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942395 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942398 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942401 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.942406 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942551 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 15:24:04.291685 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942558 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942561 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942564 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942567 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942570 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942573 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942577 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942580 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942583 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942586 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942590 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942593 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942596 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942598 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942601 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942603 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942606 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942608 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942611 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 15:24:04.293487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942614 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942616 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942619 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942622 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942624 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942631 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942634 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942636 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942639 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942642 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942645 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942647 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942650 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942652 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942656 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942659 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942662 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942665 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942667 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 15:24:04.294839 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942672 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942676 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942679 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942682 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942684 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942688 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942690 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942693 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942696 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942698 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942701 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942704 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942706 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942709 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942713 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942716 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942719 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942722 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942726 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942729 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 15:24:04.295682 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942731 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942734 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942737 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942739 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942742 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942744 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942747 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942750 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942752 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942755 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942757 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942760 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942764 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942767 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942769 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942772 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942774 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942777 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942780 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942782 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 15:24:04.296538 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942785 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942788 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942790 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942793 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942795 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942798 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942800 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942803 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942806 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942808 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942812 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942823 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942826 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942828 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942831 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942834 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942836 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942839 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942841 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 15:24:04.297379 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:03.942844 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.942849 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.942989 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.947624 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.949419 2578 server.go:1019] "Starting client certificate rotation" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.949514 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.949559 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.952713 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.956070 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.969629 2578 log.go:25] "Validated CRI v1 runtime API" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.975020 2578 log.go:25] "Validated CRI v1 image API" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.979212 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 15:24:04.298244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.982745 2578 fs.go:135] Filesystem UUIDs: map[3d5e1206-df8b-44d5-9a12-73f0abec55b2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d710d115-dcf2-4adf-ac77-2f3beef77857:/dev/nvme0n1p3] Jul 15 15:24:04.298670 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.982771 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 15:24:04.298670 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.983696 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.989103 2578 manager.go:216] Machine: {Timestamp:2026-07-15 15:24:03.986580588 +0000 UTC m=+0.382818595 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099695 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29915ebd565da1882e6517e5d88a24 SystemUUID:ec29915e-bd56-5da1-882e-6517e5d88a24 BootID:0ebc30c2-8dae-4d55-85a5-9bbfac5452a8 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:a3:bb:ab:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:a3:bb:ab:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:a7:f1:d4:56:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.989221 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.989362 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.990354 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.990385 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.991198 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.991212 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.991221 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.992400 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.993627 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996697 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996835 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996868 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996877 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996893 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996905 2578 kubelet.go:398] "Adding apiserver pod source" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.996914 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 15:24:04.302944 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.997365 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.997383 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:03.999756 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.001820 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.001849 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002036 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002052 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002060 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002067 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002077 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002083 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002753 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002761 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002768 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002774 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002783 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.002791 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.003495 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.003504 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.007043 2578 server.go:1268] "Started kubelet" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.007086 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.007160 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.007324 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.008719 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.008930 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.013182 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.013250 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.013378 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.013846 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.017053 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18c27fe9ad7bb940 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-15 15:24:04.006811968 +0000 UTC m=+0.403049976,LastTimestamp:2026-07-15 15:24:04.006811968 +0000 UTC m=+0.403049976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.019048 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.019060 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.019193 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.019682 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020107 2578 factory.go:55] Registering systemd factory Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020121 2578 factory.go:223] Registration of the systemd container factory successfully Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020159 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020176 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020274 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020284 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020349 2578 factory.go:153] Registering CRI-O factory Jul 15 15:24:04.303799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020361 2578 factory.go:223] Registration of the crio container factory successfully Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020432 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020452 2578 factory.go:103] Registering Raw factory Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.020482 2578 manager.go:1196] Started watching for new ooms in manager Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.021015 2578 manager.go:349] Starting recovery of all containers Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.029168 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kt8zg" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.029538 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.029644 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.030784 2578 manager.go:354] Recovery completed Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.035900 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.036790 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kt8zg" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.038124 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.038155 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.038170 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.041340 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.041357 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.041379 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.044512 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.045603 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.045613 2578 policy_none.go:49] "None policy: Start" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.045628 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.045632 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.045639 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.045647 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.046797 2578 policy_none.go:47] "Start" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086152 2578 manager.go:337] "Starting Device Plugin manager" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.086188 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086198 2578 server.go:87] "Starting device plugin registration server" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086497 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086512 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086623 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086711 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.086719 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.087239 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.087328 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.187316 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.188371 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.188400 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.188410 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.188437 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-61.ec2.internal" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.208821 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-61.ec2.internal" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.208848 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-61.ec2.internal\": node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.248687 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.418499 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.349587 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.543671 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.450020 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.552646 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.550783 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.659975 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.651388 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.788417 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.752156 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.921195 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.852841 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:04.925285 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.924680 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.948950 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:04.949118 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:04.953312 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.045747 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 15:19:04 +0000 UTC" deadline="2028-01-30 15:58:39.007907687 +0000 UTC" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.045780 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13536h34m33.962130687s" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:05.054156 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:05.057971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.054475 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:24:05.196557 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:05.155217 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:05.338117 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:05.255962 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:05.359900 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:05.356687 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:05.471565 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:05.456835 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 15 15:24:05.471565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.459420 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:24:05.769558 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.769507 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 15:24:05.770904 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.770880 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 15:24:05.771031 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.770929 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 15:24:05.771031 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.770958 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 15:24:05.771031 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:05.771006 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 15:24:05.773625 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.773600 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:24:05.871825 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.871724 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"] Jul 15 15:24:05.873314 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.873290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.874256 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.874235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.891197 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.891175 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.895922 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.895903 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.900267 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.900247 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 15:24:05.908168 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.908151 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 15:24:05.932627 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.932588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.932789 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.932635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.932789 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.932662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:05.998996 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:05.998945 2578 apiserver.go:52] "Watching apiserver" Jul 15 15:24:06.007350 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.007318 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 15:24:06.007747 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.007724 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qs9jt","openshift-multus/network-metrics-daemon-z75wl","openshift-network-operator/iptables-alerter-fdgjx","kube-system/global-pull-secret-syncer-6dmst","kube-system/konnectivity-agent-sckf5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq","openshift-cluster-node-tuning-operator/tuned-lm26x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal","openshift-network-diagnostics/network-check-target-mhlcd","openshift-ovn-kubernetes/ovnkube-node-mjvh7","kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal","openshift-dns/node-resolver-x88n8","openshift-image-registry/node-ca-zp67h","openshift-multus/multus-additional-cni-plugins-w2skh"] Jul 15 15:24:06.009275 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.009256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.010427 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.010401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.011432 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.011415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.011849 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.011813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mdpqs\"" Jul 15 15:24:06.011952 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.011878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.012010 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.011958 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.012880 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.012858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.012970 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.012899 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.012970 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.012932 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 15:24:06.013053 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.013100 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.013073 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:06.013253 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013238 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kspfz\"" Jul 15 15:24:06.013318 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013304 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 15:24:06.013433 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 15:24:06.013761 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013744 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.013848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bfqhk\"" Jul 15 15:24:06.013900 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.013865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.014234 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.014215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.015559 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.015535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.016403 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.016386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 15:24:06.016466 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.016406 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 15:24:06.016500 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.016386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-84qt5\"" Jul 15 15:24:06.016683 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.016667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.017631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.017616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 15:24:06.017833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.017818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:06.017928 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.017849 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.017928 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.017881 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:06.017928 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.017901 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88s66\"" Jul 15 15:24:06.018105 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.018091 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.018777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.018746 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qwf6k\"" Jul 15 15:24:06.018852 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.018837 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 15:24:06.019176 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.019163 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.019641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.019623 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 15:24:06.020312 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.020294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.021492 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.021477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.021856 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.021833 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.021856 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.021847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.021985 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.021901 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 15:24:06.021985 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.021903 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 15:24:06.022052 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.021987 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 15:24:06.022133 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 15:24:06.022367 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6d5nf\"" Jul 15 15:24:06.022700 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.022790 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.022769 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:06.022831 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.022867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022829 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjt29\"" Jul 15 15:24:06.022867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022831 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 15:24:06.022867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.022848 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.023629 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.023614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 15:24:06.023813 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.023797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 15:24:06.023860 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.023839 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 15:24:06.024051 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.024037 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kpjbn\"" Jul 15 15:24:06.032978 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.032936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-run-netns\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.032986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-log-socket\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-system-cni-dir\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-cnibin\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-os-release\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-os-release\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-slash\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb418a97-fe69-4a50-9015-404b32a84be7-kubelet-config\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb418a97-fe69-4a50-9015-404b32a84be7-dbus\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-sys-fs\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-cni-multus\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-tuned\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77822ba7-7d2b-457a-bcc8-228794784c04-agent-certs\") pod \"konnectivity-agent-sckf5\" (UID: \"77822ba7-7d2b-457a-bcc8-228794784c04\") " pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.034322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-conf-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-ovnkube-config\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033887 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-env-overrides\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.033977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h5jr\" (UniqueName: \"kubernetes.io/projected/679976f1-1adc-4c70-8d10-c889855553b9-kube-api-access-5h5jr\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-ovnkube-script-lib\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40703c45-bfd0-4618-80fb-02cad93682cc-cni-binary-copy\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-k8s-cni-cncf-io\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-netns\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysctl-conf\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-ovn\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-node-log\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tj7\" (UniqueName: \"kubernetes.io/projected/bb12d90a-500c-454e-8e30-f474d6973514-kube-api-access-s4tj7\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-socket-dir-parent\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-multus-certs\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysctl-d\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034915 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-kubelet\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-systemd-units\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.034995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-systemd\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb7b119e-8b61-4544-af4f-41f460f2469c-hosts-file\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-cni-bin\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysconfig\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-run-ovn-kubernetes\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-run\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-system-cni-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-kubelet\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.035814 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3994ed52-8269-4f13-b720-c02e89a521e8-iptables-alerter-script\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl78x\" (UniqueName: \"kubernetes.io/projected/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-kube-api-access-jl78x\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-socket-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40703c45-bfd0-4618-80fb-02cad93682cc-multus-daemon-config\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-var-lib-kubelet\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-host\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdb8\" (UniqueName: \"kubernetes.io/projected/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-kube-api-access-qsdb8\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-var-lib-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-etc-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fktql\" (UniqueName: \"kubernetes.io/projected/eb7b119e-8b61-4544-af4f-41f460f2469c-kube-api-access-fktql\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-registration-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-systemd\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-cni-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.036462 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-cni-netd\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-device-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-sys\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb12d90a-500c-454e-8e30-f474d6973514-ovn-node-metrics-cert\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-modprobe-d\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-lib-modules\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77822ba7-7d2b-457a-bcc8-228794784c04-konnectivity-ca\") pod \"konnectivity-agent-sckf5\" (UID: \"77822ba7-7d2b-457a-bcc8-228794784c04\") " pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-cni-bin\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-etc-kubernetes\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-kubernetes\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-tmp\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3994ed52-8269-4f13-b720-c02e89a521e8-host-slash\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqn68\" (UniqueName: \"kubernetes.io/projected/3994ed52-8269-4f13-b720-c02e89a521e8-kube-api-access-zqn68\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.037338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.035970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7b119e-8b61-4544-af4f-41f460f2469c-tmp-dir\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.038116 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.036011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-cnibin\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.038116 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.036049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-hostroot\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.038116 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.036076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/40703c45-bfd0-4618-80fb-02cad93682cc-kube-api-access-pw4l9\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.064352 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.064330 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmsqb" Jul 15 15:24:06.073612 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.073589 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmsqb" Jul 15 15:24:06.120887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.120856 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 15:24:06.136888 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.136867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-cni-multus\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.136971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.136896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-tuned\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.136971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.136936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77822ba7-7d2b-457a-bcc8-228794784c04-agent-certs\") pod \"konnectivity-agent-sckf5\" (UID: \"77822ba7-7d2b-457a-bcc8-228794784c04\") " pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.136971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.136957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.136975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-conf-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.136999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-ovnkube-config\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-env-overrides\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-cni-multus\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137092 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137094 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-conf-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.137564 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h5jr\" (UniqueName: \"kubernetes.io/projected/679976f1-1adc-4c70-8d10-c889855553b9-kube-api-access-5h5jr\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.137636 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-ovnkube-script-lib\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137695 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40703c45-bfd0-4618-80fb-02cad93682cc-cni-binary-copy\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137695 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-k8s-cni-cncf-io\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137695 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-netns\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysctl-conf\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-ovn\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-node-log\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tj7\" (UniqueName: \"kubernetes.io/projected/bb12d90a-500c-454e-8e30-f474d6973514-kube-api-access-s4tj7\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-socket-dir-parent\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-multus-certs\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysctl-d\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.137840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-kubelet\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-systemd-units\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-systemd\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb7b119e-8b61-4544-af4f-41f460f2469c-hosts-file\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-cni-bin\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysconfig\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-run-ovn-kubernetes\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-run\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.137996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-system-cni-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-kubelet\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3994ed52-8269-4f13-b720-c02e89a521e8-iptables-alerter-script\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl78x\" (UniqueName: \"kubernetes.io/projected/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-kube-api-access-jl78x\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138093 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.138213 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysconfig\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138131 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-systemd\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-systemd-units\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.138213 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-cni-bin\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138244 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb7b119e-8b61-4544-af4f-41f460f2469c-hosts-file\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-run-ovn-kubernetes\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.138331 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:06.638309681 +0000 UTC m=+3.034547694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysctl-d\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-socket-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-kubelet\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138461 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-multus-certs\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40703c45-bfd0-4618-80fb-02cad93682cc-cni-binary-copy\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-run-ovn\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-k8s-cni-cncf-io\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40703c45-bfd0-4618-80fb-02cad93682cc-multus-daemon-config\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.138945 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-var-lib-kubelet\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-host\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138725 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-host\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdb8\" (UniqueName: \"kubernetes.io/projected/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-kube-api-access-qsdb8\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-var-lib-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138796 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-run-netns\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-var-lib-kubelet\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-etc-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fktql\" (UniqueName: \"kubernetes.io/projected/eb7b119e-8b61-4544-af4f-41f460f2469c-kube-api-access-fktql\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138913 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-etc-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-var-lib-openvswitch\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-registration-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a439729b-98ab-4fdb-b9fb-b5384c0a1588-host\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.138990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-registration-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-host-var-lib-kubelet\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.139707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40703c45-bfd0-4618-80fb-02cad93682cc-multus-daemon-config\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-systemd\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-socket-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-system-cni-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-systemd\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-cni-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139245 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-sysctl-conf\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-cni-netd\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-device-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-sys\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb12d90a-500c-454e-8e30-f474d6973514-ovn-node-metrics-cert\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139367 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-device-dir\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-cni-netd\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-modprobe-d\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139422 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-node-log\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-sys\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-lib-modules\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.140583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-cni-dir\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-modprobe-d\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77822ba7-7d2b-457a-bcc8-228794784c04-konnectivity-ca\") pod \"konnectivity-agent-sckf5\" (UID: \"77822ba7-7d2b-457a-bcc8-228794784c04\") " pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-run\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-cni-bin\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-etc-kubernetes\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-kubernetes\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-lib-modules\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-tmp\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-multus-socket-dir-parent\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3994ed52-8269-4f13-b720-c02e89a521e8-host-slash\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-kubernetes\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-cni-bin\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqn68\" (UniqueName: \"kubernetes.io/projected/3994ed52-8269-4f13-b720-c02e89a521e8-kube-api-access-zqn68\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-etc-kubernetes\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139785 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3994ed52-8269-4f13-b720-c02e89a521e8-host-slash\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.141504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7b119e-8b61-4544-af4f-41f460f2469c-tmp-dir\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.139998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-cnibin\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-hostroot\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-cnibin\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/40703c45-bfd0-4618-80fb-02cad93682cc-kube-api-access-pw4l9\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140064 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77822ba7-7d2b-457a-bcc8-228794784c04-konnectivity-ca\") pod \"konnectivity-agent-sckf5\" (UID: \"77822ba7-7d2b-457a-bcc8-228794784c04\") " pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-hostroot\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-run-netns\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-log-socket\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-run-netns\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-system-cni-dir\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140348 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7b119e-8b61-4544-af4f-41f460f2469c-tmp-dir\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-cnibin\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-os-release\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140412 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-system-cni-dir\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-os-release\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140452 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-log-socket\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-slash\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.142273 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140455 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-cnibin\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb12d90a-500c-454e-8e30-f474d6973514-host-slash\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/679976f1-1adc-4c70-8d10-c889855553b9-os-release\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140558 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40703c45-bfd0-4618-80fb-02cad93682cc-os-release\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.140561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmsqz\" (UniqueName: \"kubernetes.io/projected/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-kube-api-access-xmsqz\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141091 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/679976f1-1adc-4c70-8d10-c889855553b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb418a97-fe69-4a50-9015-404b32a84be7-kubelet-config\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb418a97-fe69-4a50-9015-404b32a84be7-dbus\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-sys-fs\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a439729b-98ab-4fdb-b9fb-b5384c0a1588-serviceca\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nlww\" (UniqueName: \"kubernetes.io/projected/a439729b-98ab-4fdb-b9fb-b5384c0a1588-kube-api-access-8nlww\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb418a97-fe69-4a50-9015-404b32a84be7-dbus\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141285 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb418a97-fe69-4a50-9015-404b32a84be7-kubelet-config\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.143069 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141302 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-sys-fs\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141529 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-env-overrides\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-ovnkube-config\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb12d90a-500c-454e-8e30-f474d6973514-ovnkube-script-lib\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.141921 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3994ed52-8269-4f13-b720-c02e89a521e8-iptables-alerter-script\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.142459 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-etc-tuned\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.142498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-tmp\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.142680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77822ba7-7d2b-457a-bcc8-228794784c04-agent-certs\") pod \"konnectivity-agent-sckf5\" (UID: \"77822ba7-7d2b-457a-bcc8-228794784c04\") " pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.143898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.143443 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb12d90a-500c-454e-8e30-f474d6973514-ovn-node-metrics-cert\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.146752 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.146729 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:06.146842 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.146756 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:06.146842 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.146770 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:06.146842 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.146834 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:06.64681624 +0000 UTC m=+3.043054258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:06.148259 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.148232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h5jr\" (UniqueName: \"kubernetes.io/projected/679976f1-1adc-4c70-8d10-c889855553b9-kube-api-access-5h5jr\") pod \"multus-additional-cni-plugins-w2skh\" (UID: \"679976f1-1adc-4c70-8d10-c889855553b9\") " pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.149599 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.149576 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqn68\" (UniqueName: \"kubernetes.io/projected/3994ed52-8269-4f13-b720-c02e89a521e8-kube-api-access-zqn68\") pod \"iptables-alerter-fdgjx\" (UID: \"3994ed52-8269-4f13-b720-c02e89a521e8\") " pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.150216 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.150191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl78x\" (UniqueName: \"kubernetes.io/projected/fe4caed5-8137-45f4-83d0-47dc8ed9b0b3-kube-api-access-jl78x\") pod \"aws-ebs-csi-driver-node-7s5qq\" (UID: \"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.150299 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.150251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/40703c45-bfd0-4618-80fb-02cad93682cc-kube-api-access-pw4l9\") pod \"multus-qs9jt\" (UID: \"40703c45-bfd0-4618-80fb-02cad93682cc\") " pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.150543 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.150518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tj7\" (UniqueName: \"kubernetes.io/projected/bb12d90a-500c-454e-8e30-f474d6973514-kube-api-access-s4tj7\") pod \"ovnkube-node-mjvh7\" (UID: \"bb12d90a-500c-454e-8e30-f474d6973514\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.150610 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.150595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdb8\" (UniqueName: \"kubernetes.io/projected/9c63be2e-d042-4c9e-993a-2a10e0aeaad1-kube-api-access-qsdb8\") pod \"tuned-lm26x\" (UID: \"9c63be2e-d042-4c9e-993a-2a10e0aeaad1\") " pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.151147 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.151128 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fktql\" (UniqueName: \"kubernetes.io/projected/eb7b119e-8b61-4544-af4f-41f460f2469c-kube-api-access-fktql\") pod \"node-resolver-x88n8\" (UID: \"eb7b119e-8b61-4544-af4f-41f460f2469c\") " pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.159534 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.159517 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:06.170260 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.170236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdgjx" Jul 15 15:24:06.203303 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.203260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.211077 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.211025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 15 15:24:06.241874 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.241827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a439729b-98ab-4fdb-b9fb-b5384c0a1588-host\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.242147 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.242109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.242147 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.242156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a439729b-98ab-4fdb-b9fb-b5384c0a1588-host\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.242367 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.242159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmsqz\" (UniqueName: \"kubernetes.io/projected/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-kube-api-access-xmsqz\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.242367 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.242219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a439729b-98ab-4fdb-b9fb-b5384c0a1588-serviceca\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.242367 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.242240 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:06.242367 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.242252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nlww\" (UniqueName: \"kubernetes.io/projected/a439729b-98ab-4fdb-b9fb-b5384c0a1588-kube-api-access-8nlww\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.242367 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.242312 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:24:06.742291858 +0000 UTC m=+3.138529860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:06.243349 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.243330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a439729b-98ab-4fdb-b9fb-b5384c0a1588-serviceca\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.251819 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.251789 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmsqz\" (UniqueName: \"kubernetes.io/projected/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-kube-api-access-xmsqz\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.251819 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.251798 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nlww\" (UniqueName: \"kubernetes.io/projected/a439729b-98ab-4fdb-b9fb-b5384c0a1588-kube-api-access-8nlww\") pod \"node-ca-zp67h\" (UID: \"a439729b-98ab-4fdb-b9fb-b5384c0a1588\") " pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.340802 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.340755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x88n8" Jul 15 15:24:06.359420 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.359383 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w2skh" Jul 15 15:24:06.376595 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.376563 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lm26x" Jul 15 15:24:06.391619 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.391560 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:06.414172 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.414136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" Jul 15 15:24:06.432612 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.432584 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qs9jt" Jul 15 15:24:06.474500 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.474432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zp67h" Jul 15 15:24:06.553015 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.552976 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 15:24:06.645797 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.645705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:06.645945 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.645870 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:06.645945 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.645938 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:07.645922117 +0000 UTC m=+4.042160117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:06.746959 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.746921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:06.747131 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.747027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:06.747131 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.747089 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:06.747212 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.747144 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:06.747212 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.747159 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:24:07.747141743 +0000 UTC m=+4.143379742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:06.747212 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.747164 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:06.747212 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.747178 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:06.747388 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:06.747221 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:07.747208208 +0000 UTC m=+4.143446204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:06.960950 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:06.960903 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40703c45_bfd0_4618_80fb_02cad93682cc.slice/crio-b1363ba318a887df3a215be00a5af5ef59bcad6c2bdeedf603f1e5c6d681c791 WatchSource:0}: Error finding container b1363ba318a887df3a215be00a5af5ef59bcad6c2bdeedf603f1e5c6d681c791: Status 404 returned error can't find the container with id b1363ba318a887df3a215be00a5af5ef59bcad6c2bdeedf603f1e5c6d681c791 Jul 15 15:24:06.961488 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:06.961451 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4caed5_8137_45f4_83d0_47dc8ed9b0b3.slice/crio-e9553a057c55df159805a8f05f11e0ec7f27fc7a0c9b2145114737bc56acaa4d WatchSource:0}: Error finding container e9553a057c55df159805a8f05f11e0ec7f27fc7a0c9b2145114737bc56acaa4d: Status 404 returned error can't find the container with id e9553a057c55df159805a8f05f11e0ec7f27fc7a0c9b2145114737bc56acaa4d Jul 15 15:24:06.962220 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:06.962204 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77822ba7_7d2b_457a_bcc8_228794784c04.slice/crio-25f5a47ef52d922c754e51a0ff3ba161ec12fdcef8cc1bddb7992969bbb98fd6 WatchSource:0}: Error finding container 25f5a47ef52d922c754e51a0ff3ba161ec12fdcef8cc1bddb7992969bbb98fd6: Status 404 returned error can't find the container with id 25f5a47ef52d922c754e51a0ff3ba161ec12fdcef8cc1bddb7992969bbb98fd6 Jul 15 15:24:06.962915 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:06.962895 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679976f1_1adc_4c70_8d10_c889855553b9.slice/crio-c2a4fcbb8286b3f4d3868ca140467b74583fedccde75db74112dd17f1ad81c06 WatchSource:0}: Error finding container c2a4fcbb8286b3f4d3868ca140467b74583fedccde75db74112dd17f1ad81c06: Status 404 returned error can't find the container with id c2a4fcbb8286b3f4d3868ca140467b74583fedccde75db74112dd17f1ad81c06 Jul 15 15:24:06.967414 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:06.967396 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 15:24:07.006593 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.006560 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda439729b_98ab_4fdb_b9fb_b5384c0a1588.slice/crio-204c84ce0f2f3607577800c44e4fb85dce91a805d94f222e1cf0f8f32d16ed7c WatchSource:0}: Error finding container 204c84ce0f2f3607577800c44e4fb85dce91a805d94f222e1cf0f8f32d16ed7c: Status 404 returned error can't find the container with id 204c84ce0f2f3607577800c44e4fb85dce91a805d94f222e1cf0f8f32d16ed7c Jul 15 15:24:07.075262 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.075215 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:19:06 +0000 UTC" deadline="2027-12-25 15:41:16.536257367 +0000 UTC" Jul 15 15:24:07.075262 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.075255 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12672h17m9.461005835s" Jul 15 15:24:07.123855 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.123825 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb12d90a_500c_454e_8e30_f474d6973514.slice/crio-85808c482e940600a6a411c9e13c58eed61d8fdf99f2cb591bd068790b2f1d09 WatchSource:0}: Error finding container 85808c482e940600a6a411c9e13c58eed61d8fdf99f2cb591bd068790b2f1d09: Status 404 returned error can't find the container with id 85808c482e940600a6a411c9e13c58eed61d8fdf99f2cb591bd068790b2f1d09 Jul 15 15:24:07.189508 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.189476 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3994ed52_8269_4f13_b720_c02e89a521e8.slice/crio-5cd009691c5206c3daceb2b88584021cca9370df01ad1a3c38fab49fd0287cfa WatchSource:0}: Error finding container 5cd009691c5206c3daceb2b88584021cca9370df01ad1a3c38fab49fd0287cfa: Status 404 returned error can't find the container with id 5cd009691c5206c3daceb2b88584021cca9370df01ad1a3c38fab49fd0287cfa Jul 15 15:24:07.190487 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.190447 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc0c7a3681d7c042fbc0dd13cac7333.slice/crio-a1e764e73a015f13bb53fe9ad9451bc33af2694ea93c8a32adc0281bb2c8ff32 WatchSource:0}: Error finding container a1e764e73a015f13bb53fe9ad9451bc33af2694ea93c8a32adc0281bb2c8ff32: Status 404 returned error can't find the container with id a1e764e73a015f13bb53fe9ad9451bc33af2694ea93c8a32adc0281bb2c8ff32 Jul 15 15:24:07.220661 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.220630 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c63be2e_d042_4c9e_993a_2a10e0aeaad1.slice/crio-e2276679f1f3e3e2acd603755f8d915de6d32cab86db1744a081238116384d22 WatchSource:0}: Error finding container e2276679f1f3e3e2acd603755f8d915de6d32cab86db1744a081238116384d22: Status 404 returned error can't find the container with id e2276679f1f3e3e2acd603755f8d915de6d32cab86db1744a081238116384d22 Jul 15 15:24:07.270485 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.270449 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7b119e_8b61_4544_af4f_41f460f2469c.slice/crio-75a76f3a896cab92e551ae17911f523e018e487cc79bc339d7fc9a7269b4ea8e WatchSource:0}: Error finding container 75a76f3a896cab92e551ae17911f523e018e487cc79bc339d7fc9a7269b4ea8e: Status 404 returned error can't find the container with id 75a76f3a896cab92e551ae17911f523e018e487cc79bc339d7fc9a7269b4ea8e Jul 15 15:24:07.289772 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:07.289742 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c90a46431eae6b3cdd7f5745d0d2187.slice/crio-37e44c54b4629dc0227ed2b0e6daf90326b1e073d2b9fae98c23e0751ce0f370 WatchSource:0}: Error finding container 37e44c54b4629dc0227ed2b0e6daf90326b1e073d2b9fae98c23e0751ce0f370: Status 404 returned error can't find the container with id 37e44c54b4629dc0227ed2b0e6daf90326b1e073d2b9fae98c23e0751ce0f370 Jul 15 15:24:07.655953 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.655813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:07.656144 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.655997 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:07.656144 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.656080 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:09.656058621 +0000 UTC m=+6.052296621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.756819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.756892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.757050 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.757118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:24:09.757098079 +0000 UTC m=+6.153336078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.757575 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.757601 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.757615 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:07.757714 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.757664 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:09.757649043 +0000 UTC m=+6.153887043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:07.772331 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.772234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:07.772551 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.772379 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:07.772688 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.772664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:07.772810 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.772785 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:07.772885 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.772817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:07.772964 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:07.772942 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:07.779731 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.779675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerStarted","Data":"a1e764e73a015f13bb53fe9ad9451bc33af2694ea93c8a32adc0281bb2c8ff32"} Jul 15 15:24:07.781480 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.781451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"85808c482e940600a6a411c9e13c58eed61d8fdf99f2cb591bd068790b2f1d09"} Jul 15 15:24:07.783852 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.783822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zp67h" event={"ID":"a439729b-98ab-4fdb-b9fb-b5384c0a1588","Type":"ContainerStarted","Data":"204c84ce0f2f3607577800c44e4fb85dce91a805d94f222e1cf0f8f32d16ed7c"} Jul 15 15:24:07.785488 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.785446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerStarted","Data":"c2a4fcbb8286b3f4d3868ca140467b74583fedccde75db74112dd17f1ad81c06"} Jul 15 15:24:07.787628 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.787602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sckf5" event={"ID":"77822ba7-7d2b-457a-bcc8-228794784c04","Type":"ContainerStarted","Data":"25f5a47ef52d922c754e51a0ff3ba161ec12fdcef8cc1bddb7992969bbb98fd6"} Jul 15 15:24:07.790356 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.790257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"5c90a46431eae6b3cdd7f5745d0d2187","Type":"ContainerStarted","Data":"37e44c54b4629dc0227ed2b0e6daf90326b1e073d2b9fae98c23e0751ce0f370"} Jul 15 15:24:07.795287 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.795253 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x88n8" event={"ID":"eb7b119e-8b61-4544-af4f-41f460f2469c","Type":"ContainerStarted","Data":"75a76f3a896cab92e551ae17911f523e018e487cc79bc339d7fc9a7269b4ea8e"} Jul 15 15:24:07.797870 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.797792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lm26x" event={"ID":"9c63be2e-d042-4c9e-993a-2a10e0aeaad1","Type":"ContainerStarted","Data":"e2276679f1f3e3e2acd603755f8d915de6d32cab86db1744a081238116384d22"} Jul 15 15:24:07.801898 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.801866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdgjx" event={"ID":"3994ed52-8269-4f13-b720-c02e89a521e8","Type":"ContainerStarted","Data":"5cd009691c5206c3daceb2b88584021cca9370df01ad1a3c38fab49fd0287cfa"} Jul 15 15:24:07.805504 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.805421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" event={"ID":"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3","Type":"ContainerStarted","Data":"e9553a057c55df159805a8f05f11e0ec7f27fc7a0c9b2145114737bc56acaa4d"} Jul 15 15:24:07.814000 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:07.813924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qs9jt" event={"ID":"40703c45-bfd0-4618-80fb-02cad93682cc","Type":"ContainerStarted","Data":"b1363ba318a887df3a215be00a5af5ef59bcad6c2bdeedf603f1e5c6d681c791"} Jul 15 15:24:08.075767 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:08.075639 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:19:06 +0000 UTC" deadline="2028-04-21 23:09:24.994018742 +0000 UTC" Jul 15 15:24:08.075767 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:08.075711 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15511h45m16.918312221s" Jul 15 15:24:09.679653 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:09.678992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:09.679653 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.679189 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:09.679653 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.679260 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:13.67923967 +0000 UTC m=+10.075477672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:09.774453 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:09.772711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:09.774453 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.773079 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:09.774453 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:09.773521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:09.774453 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.773656 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:09.774453 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:09.773794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:09.774453 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.773889 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:09.779753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:09.779839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.779983 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.780000 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.780014 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.780069 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:13.780048979 +0000 UTC m=+10.176286988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.780455 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:09.780731 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:09.780501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:24:13.780486713 +0000 UTC m=+10.176724722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:11.772262 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:11.771694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:11.772262 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:11.771881 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:11.772262 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:11.771918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:11.772262 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:11.772029 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:11.772262 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:11.771919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:11.772262 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:11.772154 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:13.718002 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:13.717940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:13.718452 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.718118 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:13.718452 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.718197 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:21.718176473 +0000 UTC m=+18.114414468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:13.773147 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:13.772796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:13.773147 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:13.772806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:13.773147 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.773025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:13.773147 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.772902 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:13.773147 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:13.773106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:13.773418 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.773175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:13.819201 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:13.819160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:13.819368 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:13.819228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:13.819368 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.819353 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:13.819507 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.819374 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:13.819507 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.819392 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:13.819507 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.819406 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:13.819507 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.819420 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:24:21.819401656 +0000 UTC m=+18.215639666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:13.819507 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:13.819441 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:21.819431278 +0000 UTC m=+18.215669280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:15.773107 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:15.772321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:15.773107 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:15.772435 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:15.773107 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:15.772819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:15.773107 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:15.772904 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:15.773107 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:15.772978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:15.773107 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:15.773075 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:17.771960 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:17.771861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:17.772410 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:17.771862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:17.772410 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:17.771998 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:17.772410 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:17.772089 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:17.772410 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:17.771862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:17.772410 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:17.772194 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:19.771755 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:19.771723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:19.772091 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:19.771730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:19.772091 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:19.771829 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:19.772091 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:19.771913 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:19.772091 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:19.771730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:19.772091 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:19.771996 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:21.772203 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:21.772162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:21.772653 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:21.772161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:21.772653 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.772302 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:21.772653 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:21.772319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:21.772653 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.772415 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:21.772653 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.772523 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:21.778353 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:21.778327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:21.778509 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.778490 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:21.778578 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.778560 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:37.778541699 +0000 UTC m=+34.174779701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:21.879341 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:21.879298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:21.879341 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:21.879348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:21.879569 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.879460 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:21.879569 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.879503 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:21.879569 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.879527 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:21.879569 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.879537 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:21.879569 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.879537 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:24:37.879523278 +0000 UTC m=+34.275761285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:21.879759 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:21.879592 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:37.879576732 +0000 UTC m=+34.275814726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:23.771610 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:23.771364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:23.772066 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:23.771364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:23.772066 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:23.771402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:23.772066 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:23.771798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:23.772066 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:23.771931 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:23.772066 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:23.772027 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:25.773293 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:25.772929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:25.773293 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:25.773063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:25.773293 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:25.773100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:25.773293 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:25.773067 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:25.773293 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:25.773191 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:25.773293 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:25.773292 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:27.771508 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:27.771482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:27.771508 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:27.771498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:27.771885 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:27.771521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:27.771885 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:27.771588 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:27.771885 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:27.771666 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:27.771885 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:27.771740 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:28.869330 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.869144 2578 generic.go:356] "Generic (PLEG): container finished" podID="679976f1-1adc-4c70-8d10-c889855553b9" containerID="bf69e1dc1af39b3bfaf305a579c819984060164116c1ed618157e75fa40d5bb2" exitCode=0 Jul 15 15:24:28.870191 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.869240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerDied","Data":"bf69e1dc1af39b3bfaf305a579c819984060164116c1ed618157e75fa40d5bb2"} Jul 15 15:24:28.871022 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.870990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sckf5" event={"ID":"77822ba7-7d2b-457a-bcc8-228794784c04","Type":"ContainerStarted","Data":"ca020006a0f32f221738331499fb0322de96b5e05c45c679cea780b5fa98cc1e"} Jul 15 15:24:28.872452 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.872428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"5c90a46431eae6b3cdd7f5745d0d2187","Type":"ContainerStarted","Data":"69972fec4f18eaac3d2bd4012816d3f26a8861c957b7db03c1be06b2e7b5291a"} Jul 15 15:24:28.873702 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.873682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x88n8" event={"ID":"eb7b119e-8b61-4544-af4f-41f460f2469c","Type":"ContainerStarted","Data":"0955eb0024e700cc41e4725c98acaa7eeb251e389819b63f86dbe8efebe63695"} Jul 15 15:24:28.875167 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.875148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lm26x" event={"ID":"9c63be2e-d042-4c9e-993a-2a10e0aeaad1","Type":"ContainerStarted","Data":"56a052580409d793a5f12329dc17120d875053496137aaee5baa75ee87fe140b"} Jul 15 15:24:28.876532 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.876511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" event={"ID":"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3","Type":"ContainerStarted","Data":"c2ae175c3902a4df7b99f485ad2399a314d97098524101495e1a7a9c913b7dc5"} Jul 15 15:24:28.877774 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.877752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qs9jt" event={"ID":"40703c45-bfd0-4618-80fb-02cad93682cc","Type":"ContainerStarted","Data":"2106bf47bf258008667ef31879d2f944aab5acd399ce73c60df19caa3e7651b1"} Jul 15 15:24:28.879127 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.879108 2578 generic.go:356] "Generic (PLEG): container finished" podID="4bc0c7a3681d7c042fbc0dd13cac7333" containerID="d9dfa81a9530c64f7658c2bcc30493ff451280270794a305977bdd925e3b3625" exitCode=0 Jul 15 15:24:28.879194 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.879171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerDied","Data":"d9dfa81a9530c64f7658c2bcc30493ff451280270794a305977bdd925e3b3625"} Jul 15 15:24:28.881946 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.881923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:24:28.882237 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882219 2578 generic.go:356] "Generic (PLEG): container finished" podID="bb12d90a-500c-454e-8e30-f474d6973514" containerID="ed596da68a8720b36112815da5f5b02dd59985cc42d6e2e39df61aa8766e1cd6" exitCode=1 Jul 15 15:24:28.882298 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"5613f3fa8d739a9a7366320b896a167db11e1174c7e00042627158ca2b4cc45b"} Jul 15 15:24:28.882335 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"0cd0a609bed90fa5fa6c4ef3a6da1d36a0fac26b0d8525df1b39b418d29f8c91"} Jul 15 15:24:28.882367 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"38234783c9f1b741bba62e9a8da4ead879069a02db076f02a890788d5076df3e"} Jul 15 15:24:28.882416 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"1a672287e853e06a0dfad301baa1aa22bb91f74ed318ea4d50609b3bcab5fde1"} Jul 15 15:24:28.882451 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerDied","Data":"ed596da68a8720b36112815da5f5b02dd59985cc42d6e2e39df61aa8766e1cd6"} Jul 15 15:24:28.882560 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.882497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"3eb5ad9ade3bebe0e44d49e0fae2617cb07bea4e0a402b25e86d70c16e9fded9"} Jul 15 15:24:28.883483 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.883449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zp67h" event={"ID":"a439729b-98ab-4fdb-b9fb-b5384c0a1588","Type":"ContainerStarted","Data":"8f217d2760c361a8e3a91afdc0e2ca4865e3cfc61960f29436a246d2fc87280b"} Jul 15 15:24:28.912830 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.911211 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lm26x" podStartSLOduration=3.317926014 podStartE2EDuration="23.911190661s" totalImagesPullingTime="20.593264647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:28.9100974 +0000 UTC m=+25.306335417" watchObservedRunningTime="2026-07-15 15:24:28.911190661 +0000 UTC m=+25.307428678" Jul 15 15:24:28.925797 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.925751 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x88n8" podStartSLOduration=4.404073378 podStartE2EDuration="24.925735845s" totalImagesPullingTime="20.521662467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:28.925429839 +0000 UTC m=+25.321667856" watchObservedRunningTime="2026-07-15 15:24:28.925735845 +0000 UTC m=+25.321973857" Jul 15 15:24:28.951022 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.950975 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sckf5" podStartSLOduration=3.126256086 podStartE2EDuration="23.95095918s" totalImagesPullingTime="20.824703094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:28.949390285 +0000 UTC m=+25.345628312" watchObservedRunningTime="2026-07-15 15:24:28.95095918 +0000 UTC m=+25.347197196" Jul 15 15:24:28.970566 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.970525 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qs9jt" podStartSLOduration=3.085490268 podStartE2EDuration="23.970512939s" totalImagesPullingTime="20.885022671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:28.970182588 +0000 UTC m=+25.366420605" watchObservedRunningTime="2026-07-15 15:24:28.970512939 +0000 UTC m=+25.366750946" Jul 15 15:24:28.985066 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.985026 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zp67h" podStartSLOduration=3.200835193 podStartE2EDuration="23.98501198s" totalImagesPullingTime="20.784176787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:28.984800243 +0000 UTC m=+25.381038270" watchObservedRunningTime="2026-07-15 15:24:28.98501198 +0000 UTC m=+25.381249996" Jul 15 15:24:28.998565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:28.998512 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podStartSLOduration=22.998496485 podStartE2EDuration="22.998496485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:28.998119259 +0000 UTC m=+25.394357275" watchObservedRunningTime="2026-07-15 15:24:28.998496485 +0000 UTC m=+25.394734501" Jul 15 15:24:29.771295 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.771268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:29.771451 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.771321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:29.771451 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.771337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:29.771451 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:29.771400 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:29.771629 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:29.771501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:29.771629 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:29.771600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:29.867980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.867956 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 15:24:29.886757 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.886724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdgjx" event={"ID":"3994ed52-8269-4f13-b720-c02e89a521e8","Type":"ContainerStarted","Data":"a4e89952edc7820cae22914900361cc55af73ff256c41e826a34a0e100740d21"} Jul 15 15:24:29.888528 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.888504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" event={"ID":"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3","Type":"ContainerStarted","Data":"8af72b40bfbf5f8bde7dc7624419e442bea5750fd17a273b623868f8b9233b1c"} Jul 15 15:24:29.890159 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.890128 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerStarted","Data":"dfd02dea1b848566a29e79bad46ff226b99ac63be3f1eb5ace1f530092815cef"} Jul 15 15:24:29.901359 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.901316 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fdgjx" podStartSLOduration=4.300426442 podStartE2EDuration="24.901302642s" totalImagesPullingTime="20.6008762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:29.901178016 +0000 UTC m=+26.297416045" watchObservedRunningTime="2026-07-15 15:24:29.901302642 +0000 UTC m=+26.297540657" Jul 15 15:24:29.915512 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:29.915452 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" podStartSLOduration=23.915438853 podStartE2EDuration="23.915438853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:29.915239043 +0000 UTC m=+26.311477059" watchObservedRunningTime="2026-07-15 15:24:29.915438853 +0000 UTC m=+26.311676868" Jul 15 15:24:30.100450 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:30.100313 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T15:24:29.867975906Z","UUID":"ff043840-64dd-4af9-b1db-c2b51087f5ea","Handler":null,"Name":"","Endpoint":""} Jul 15 15:24:30.101778 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:30.101757 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 15:24:30.101884 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:30.101795 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 15:24:30.896670 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:30.896634 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:24:30.897176 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:30.897087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"0a314ed8540f6c71267d0126c65d7eac693ab50fc305433d59cf063135da07ac"} Jul 15 15:24:31.196601 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.196516 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:31.197410 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.197343 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:31.771880 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.771850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:31.772080 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.771973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:31.772080 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:31.771984 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:31.772195 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:31.772085 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:31.772195 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.772113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:31.772195 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:31.772167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:31.899123 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.899090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:31.899626 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:31.899606 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sckf5" Jul 15 15:24:32.903903 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:32.903856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" event={"ID":"fe4caed5-8137-45f4-83d0-47dc8ed9b0b3","Type":"ContainerStarted","Data":"01426a5238833c8d3d5eba680cb131085efb21b4292e2cac47487ae53ea92cc7"} Jul 15 15:24:32.921846 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:32.921795 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7s5qq" podStartSLOduration=4.006799243 podStartE2EDuration="27.921780149s" totalImagesPullingTime="23.914980906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:32.92114714 +0000 UTC m=+29.317385174" watchObservedRunningTime="2026-07-15 15:24:32.921780149 +0000 UTC m=+29.318018165" Jul 15 15:24:33.772053 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:33.772011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:33.772239 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:33.772048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:33.772239 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:33.772012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:33.772239 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:33.772144 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:33.772408 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:33.772242 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:33.772408 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:33.772337 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:34.912339 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.912164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:24:34.913268 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.912668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"6b591019d84a89eeeae6cf0c4246858773b0e8a46a6c78c131bc15d0f9bb79d5"} Jul 15 15:24:34.913268 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.912939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:34.913268 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.913146 2578 scope.go:117] "RemoveContainer" containerID="ed596da68a8720b36112815da5f5b02dd59985cc42d6e2e39df61aa8766e1cd6" Jul 15 15:24:34.914590 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.914569 2578 generic.go:356] "Generic (PLEG): container finished" podID="679976f1-1adc-4c70-8d10-c889855553b9" containerID="b56889a3a2d3cc15b7afb5030c435beedc6d553f7d8a7c5f000e3bd8c035c761" exitCode=0 Jul 15 15:24:34.914682 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.914605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerDied","Data":"b56889a3a2d3cc15b7afb5030c435beedc6d553f7d8a7c5f000e3bd8c035c761"} Jul 15 15:24:34.929799 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:34.929772 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:35.772824 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.772789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:35.773092 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.772875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:35.773092 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.772922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:35.773092 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:35.772934 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:35.773092 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:35.772981 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:35.773300 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:35.773114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:35.920090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.920066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:24:35.920542 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.920444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" event={"ID":"bb12d90a-500c-454e-8e30-f474d6973514","Type":"ContainerStarted","Data":"c949e843eb845d4b599ee133ad52b464682a02d4e69b659b63457b54576179c3"} Jul 15 15:24:35.920848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.920813 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:35.920929 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.920909 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:35.936151 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.936127 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:24:35.952707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:35.952657 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" podStartSLOduration=10.208835678 podStartE2EDuration="30.952640751s" totalImagesPullingTime="20.743805073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:35.951408175 +0000 UTC m=+32.347646194" watchObservedRunningTime="2026-07-15 15:24:35.952640751 +0000 UTC m=+32.348878764" Jul 15 15:24:36.397230 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.397144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhlcd"] Jul 15 15:24:36.397371 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.397256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:36.397371 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:36.397338 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:36.399970 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.399947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6dmst"] Jul 15 15:24:36.400100 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.400029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:36.400141 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:36.400098 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:36.402538 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.402517 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z75wl"] Jul 15 15:24:36.402639 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.402594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:36.402696 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:36.402667 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:36.927720 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.927687 2578 generic.go:356] "Generic (PLEG): container finished" podID="679976f1-1adc-4c70-8d10-c889855553b9" containerID="1387763603a1956ddefc75f2399ef6cede15967439f9bdd34ac6402478c1499e" exitCode=0 Jul 15 15:24:36.928179 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:36.927774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerDied","Data":"1387763603a1956ddefc75f2399ef6cede15967439f9bdd34ac6402478c1499e"} Jul 15 15:24:37.771864 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:37.771818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:37.772050 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.771977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:37.772050 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:37.772033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:37.772162 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.772141 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:37.794139 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:37.794104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:37.794288 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.794229 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:37.794337 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.794313 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret podName:fb418a97-fe69-4a50-9015-404b32a84be7 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:09.794289971 +0000 UTC m=+66.190527977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret") pod "global-pull-secret-syncer-6dmst" (UID: "fb418a97-fe69-4a50-9015-404b32a84be7") : object "kube-system"/"original-pull-secret" not registered Jul 15 15:24:37.894697 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:37.894617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:37.894697 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:37.894674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:37.894915 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.894773 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 15:24:37.894915 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.894778 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:37.894915 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.894849 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:25:09.894830189 +0000 UTC m=+66.291068199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 15:24:37.894915 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.894786 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 15:24:37.894915 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.894882 2578 projected.go:196] Error preparing data for projected volume kube-api-access-fkjj4 for pod openshift-network-diagnostics/network-check-target-mhlcd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:37.895140 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:37.894921 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4 podName:92c73c32-616c-478b-a719-c60e7ffabd37 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:09.894911481 +0000 UTC m=+66.291149475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkjj4" (UniqueName: "kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4") pod "network-check-target-mhlcd" (UID: "92c73c32-616c-478b-a719-c60e7ffabd37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 15:24:38.771396 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:38.771361 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:38.771798 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:38.771504 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:38.935002 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:38.934971 2578 generic.go:356] "Generic (PLEG): container finished" podID="679976f1-1adc-4c70-8d10-c889855553b9" containerID="4e5931b9965506496abe0a98f8aade926afdde1d8492f58f0c508fbd966a3561" exitCode=0 Jul 15 15:24:38.935192 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:38.935053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerDied","Data":"4e5931b9965506496abe0a98f8aade926afdde1d8492f58f0c508fbd966a3561"} Jul 15 15:24:39.771253 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:39.771218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:39.771424 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:39.771344 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z75wl" podUID="f1e695ec-b4be-4a8b-b47e-8eed3ba65faf" Jul 15 15:24:39.771424 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:39.771378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:39.771735 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:39.771443 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhlcd" podUID="92c73c32-616c-478b-a719-c60e7ffabd37" Jul 15 15:24:40.772191 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.771978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:40.772621 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:40.772303 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6dmst" podUID="fb418a97-fe69-4a50-9015-404b32a84be7" Jul 15 15:24:40.887374 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.887300 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeReady" Jul 15 15:24:40.887532 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.887524 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 15:24:40.926573 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.926537 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76d8f4f569-rhfqw"] Jul 15 15:24:40.930405 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.930373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:40.932797 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.932777 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 15:24:40.932912 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.932806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 15:24:40.932985 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.932915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdzpm\"" Jul 15 15:24:40.933073 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.933056 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 15:24:40.935737 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.935713 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w4tqc"] Jul 15 15:24:40.939612 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.939586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:40.940581 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.940560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 15:24:40.941771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.941750 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 15:24:40.941875 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.941842 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fj5z9\"" Jul 15 15:24:40.942102 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.942080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 15:24:40.943048 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.943021 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d8f4f569-rhfqw"] Jul 15 15:24:40.945976 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.945924 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sv5mr"] Jul 15 15:24:40.950157 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.949753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:40.952553 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.952454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w4tqc"] Jul 15 15:24:40.952677 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.952648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-scxjf\"" Jul 15 15:24:40.952911 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.952895 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 15:24:40.953154 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.953140 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 15:24:40.954169 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.954053 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 15:24:40.957695 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:40.957673 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sv5mr"] Jul 15 15:24:41.015113 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e934a77-7ff4-4554-8e57-cf7b679e03c6-ca-trust-extracted\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015113 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-image-registry-private-configuration\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015373 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvtv\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-kube-api-access-psvtv\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015373 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-installation-pull-secrets\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015373 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-trusted-ca\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015373 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015572 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-certificates\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.015572 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.015475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-bound-sa-token\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.116671 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-installation-pull-secrets\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.116848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-trusted-ca\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.116848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.116848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-certificates\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.116848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-bound-sa-token\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.116848 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcf9\" (UniqueName: \"kubernetes.io/projected/55a995c9-c058-4dd7-9dc4-4a7dd887349d-kube-api-access-6xcf9\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e934a77-7ff4-4554-8e57-cf7b679e03c6-ca-trust-extracted\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5gs\" (UniqueName: \"kubernetes.io/projected/5e259c1b-9c11-4422-a13f-9d386d07a847-kube-api-access-qp5gs\") pod \"ingress-canary-sv5mr\" (UID: \"5e259c1b-9c11-4422-a13f-9d386d07a847\") " pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.116893 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-image-registry-private-configuration\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvtv\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-kube-api-access-psvtv\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.116996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55a995c9-c058-4dd7-9dc4-4a7dd887349d-config-volume\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.117011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e259c1b-9c11-4422-a13f-9d386d07a847-cert\") pod \"ingress-canary-sv5mr\" (UID: \"5e259c1b-9c11-4422-a13f-9d386d07a847\") " pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.117025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a995c9-c058-4dd7-9dc4-4a7dd887349d-tmp-dir\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.117090 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.116916 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:24:41.117555 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.117147 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:41.61712477 +0000 UTC m=+38.013362779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:24:41.117555 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.117530 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e934a77-7ff4-4554-8e57-cf7b679e03c6-ca-trust-extracted\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.117744 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.117699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-certificates\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.118805 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.118777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-trusted-ca\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.121534 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.121511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-installation-pull-secrets\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.121674 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.121572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-image-registry-private-configuration\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.126822 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.126783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-bound-sa-token\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.126939 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.126907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvtv\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-kube-api-access-psvtv\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.218141 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcf9\" (UniqueName: \"kubernetes.io/projected/55a995c9-c058-4dd7-9dc4-4a7dd887349d-kube-api-access-6xcf9\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.218333 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5gs\" (UniqueName: \"kubernetes.io/projected/5e259c1b-9c11-4422-a13f-9d386d07a847-kube-api-access-qp5gs\") pod \"ingress-canary-sv5mr\" (UID: \"5e259c1b-9c11-4422-a13f-9d386d07a847\") " pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.218333 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.218333 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55a995c9-c058-4dd7-9dc4-4a7dd887349d-config-volume\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.218333 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e259c1b-9c11-4422-a13f-9d386d07a847-cert\") pod \"ingress-canary-sv5mr\" (UID: \"5e259c1b-9c11-4422-a13f-9d386d07a847\") " pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.218577 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.218359 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:24:41.218577 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.218427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:41.718406799 +0000 UTC m=+38.114644811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:24:41.218577 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a995c9-c058-4dd7-9dc4-4a7dd887349d-tmp-dir\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.218883 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a995c9-c058-4dd7-9dc4-4a7dd887349d-tmp-dir\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.218985 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.218956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55a995c9-c058-4dd7-9dc4-4a7dd887349d-config-volume\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.220856 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.220837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e259c1b-9c11-4422-a13f-9d386d07a847-cert\") pod \"ingress-canary-sv5mr\" (UID: \"5e259c1b-9c11-4422-a13f-9d386d07a847\") " pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.227923 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.227899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcf9\" (UniqueName: \"kubernetes.io/projected/55a995c9-c058-4dd7-9dc4-4a7dd887349d-kube-api-access-6xcf9\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.228063 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.228046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5gs\" (UniqueName: \"kubernetes.io/projected/5e259c1b-9c11-4422-a13f-9d386d07a847-kube-api-access-qp5gs\") pod \"ingress-canary-sv5mr\" (UID: \"5e259c1b-9c11-4422-a13f-9d386d07a847\") " pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.264701 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.264673 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sv5mr" Jul 15 15:24:41.429253 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.429210 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sv5mr"] Jul 15 15:24:41.434461 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:41.434429 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e259c1b_9c11_4422_a13f_9d386d07a847.slice/crio-1ed10b61332aa335944f4da03b04c8e6636bc8ab0e569b13dd2da37c1a78efaa WatchSource:0}: Error finding container 1ed10b61332aa335944f4da03b04c8e6636bc8ab0e569b13dd2da37c1a78efaa: Status 404 returned error can't find the container with id 1ed10b61332aa335944f4da03b04c8e6636bc8ab0e569b13dd2da37c1a78efaa Jul 15 15:24:41.622150 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.622052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:41.622309 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.622227 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:24:41.622309 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.622256 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:24:41.622423 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.622321 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:42.622300201 +0000 UTC m=+39.018538211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:24:41.723303 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.723265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:41.723490 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.723366 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:24:41.723490 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:41.723428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:42.72341129 +0000 UTC m=+39.119649284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:24:41.771669 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.771637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:24:41.771871 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.771848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:24:41.774908 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.774883 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qs6fl\"" Jul 15 15:24:41.775701 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.775238 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 15:24:41.775701 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.775354 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h9ndf\"" Jul 15 15:24:41.775701 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.775458 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 15:24:41.775701 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.775600 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 15:24:41.942974 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:41.942865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sv5mr" event={"ID":"5e259c1b-9c11-4422-a13f-9d386d07a847","Type":"ContainerStarted","Data":"1ed10b61332aa335944f4da03b04c8e6636bc8ab0e569b13dd2da37c1a78efaa"} Jul 15 15:24:42.273964 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.273920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:42.373385 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.373350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:42.631178 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.631094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:42.631345 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:42.631273 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:24:42.631345 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:42.631293 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:24:42.631432 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:42.631360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:44.631339541 +0000 UTC m=+41.027577539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:24:42.644623 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.644576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:42.717238 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.717196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:42.732251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.732220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:42.732422 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:42.732354 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:24:42.732422 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:42.732419 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:44.732401757 +0000 UTC m=+41.128639764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:24:42.771405 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.771370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:24:42.774369 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:42.774349 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 15:24:44.648624 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:44.648361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:44.649126 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:44.648558 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:24:44.649126 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:44.648718 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:24:44.649126 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:44.648793 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:48.648771079 +0000 UTC m=+45.045009075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:24:44.749636 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:44.749594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:44.749818 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:44.749781 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:24:44.749878 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:44.749855 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:48.749838118 +0000 UTC m=+45.146076117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:24:45.957995 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:45.957961 2578 generic.go:356] "Generic (PLEG): container finished" podID="679976f1-1adc-4c70-8d10-c889855553b9" containerID="753cdde6d16d9e5f2a464d8545ba5cbd62205ab3a6c3d0286ac8d6254459f6d7" exitCode=0 Jul 15 15:24:45.958433 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:45.958009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerDied","Data":"753cdde6d16d9e5f2a464d8545ba5cbd62205ab3a6c3d0286ac8d6254459f6d7"} Jul 15 15:24:45.959493 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:45.959454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sv5mr" event={"ID":"5e259c1b-9c11-4422-a13f-9d386d07a847","Type":"ContainerStarted","Data":"86c0f421c1d064d8d9ec53984029b77e78058e22cf094e3dc68c78ee86a68116"} Jul 15 15:24:46.004185 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:46.004130 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sv5mr" podStartSLOduration=1.956161426 podStartE2EDuration="6.004111978s" totalImagesPullingTime="4.047950552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:46.003521161 +0000 UTC m=+42.399759181" watchObservedRunningTime="2026-07-15 15:24:46.004111978 +0000 UTC m=+42.400349998" Jul 15 15:24:46.348234 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:46.348146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:46.526096 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:46.526058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:46.964822 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:46.964789 2578 generic.go:356] "Generic (PLEG): container finished" podID="679976f1-1adc-4c70-8d10-c889855553b9" containerID="78fe12fe1bbf40b06f9463365ec1965398c0b15fd6a39f7061da58daaed4327c" exitCode=0 Jul 15 15:24:46.965179 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:46.964871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerDied","Data":"78fe12fe1bbf40b06f9463365ec1965398c0b15fd6a39f7061da58daaed4327c"} Jul 15 15:24:47.970144 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:47.970111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w2skh" event={"ID":"679976f1-1adc-4c70-8d10-c889855553b9","Type":"ContainerStarted","Data":"712d1918c10f55e76deaba5f17271b5ae7a3514b9d41af0a18f0cd7332996e52"} Jul 15 15:24:47.993507 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:47.993437 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w2skh" podStartSLOduration=8.747376035 podStartE2EDuration="43.993421138s" totalImagesPullingTime="35.246045103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:24:47.993092718 +0000 UTC m=+44.389330736" watchObservedRunningTime="2026-07-15 15:24:47.993421138 +0000 UTC m=+44.389659153" Jul 15 15:24:48.116131 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:48.116093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:48.276989 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:48.276902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" limit=1024 Jul 15 15:24:48.678109 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:48.678025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:48.678258 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:48.678149 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:24:48.678258 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:48.678163 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:24:48.678258 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:48.678223 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:56.678208884 +0000 UTC m=+53.074446878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:24:48.778563 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:48.778521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:48.778756 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:48.778698 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:24:48.778829 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:48.778777 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:24:56.778754115 +0000 UTC m=+53.174992112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:24:56.735480 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:56.735441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:24:56.735926 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:56.735603 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:24:56.735926 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:56.735623 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:24:56.735926 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:56.735717 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:12.735700351 +0000 UTC m=+69.131938347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:24:56.836346 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:56.836303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:24:56.836517 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:56.836482 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:24:56.836558 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:56.836550 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:25:12.836534884 +0000 UTC m=+69.232772878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:24:59.007851 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.007818 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk"] Jul 15 15:24:59.022830 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.022802 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg"] Jul 15 15:24:59.022968 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.022915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" Jul 15 15:24:59.027063 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.027039 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2p8lm\"" Jul 15 15:24:59.036861 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.036832 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk"] Jul 15 15:24:59.036971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.036879 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rtw7x"] Jul 15 15:24:59.036971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.036958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" Jul 15 15:24:59.041870 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.041843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9sb7d\"" Jul 15 15:24:59.042010 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.041893 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.042071 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.042004 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.051956 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.051929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvvb\" (UniqueName: \"kubernetes.io/projected/856d30db-25fd-4d5f-bcb6-1a77c42b6d90-kube-api-access-6gvvb\") pod \"network-check-source-869dcfcdcd-l64mk\" (UID: \"856d30db-25fd-4d5f-bcb6-1a77c42b6d90\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" Jul 15 15:24:59.052106 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.052000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgrdn\" (UniqueName: \"kubernetes.io/projected/a00c0c57-b380-4103-abc9-e765c7daac2e-kube-api-access-rgrdn\") pod \"volume-data-source-validator-78495597f6-jm5sg\" (UID: \"a00c0c57-b380-4103-abc9-e765c7daac2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" Jul 15 15:24:59.058970 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.058944 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg"] Jul 15 15:24:59.059118 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.058982 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6mxld"] Jul 15 15:24:59.059118 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.059086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.062702 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.062682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 15:24:59.062931 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.062916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w9djq\"" Jul 15 15:24:59.063138 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.063124 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 15:24:59.082964 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.082941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6mxld"] Jul 15 15:24:59.082964 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.082969 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rtw7x"] Jul 15 15:24:59.083140 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.083047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.085430 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.085399 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 15:24:59.085430 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.085408 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.085630 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.085445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t4txz\"" Jul 15 15:24:59.085714 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.085674 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 15:24:59.085777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.085754 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.092674 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.092651 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 15:24:59.109702 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.109673 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc"] Jul 15 15:24:59.123297 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.123260 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-rc6rf"] Jul 15 15:24:59.123447 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.123420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.126670 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.126647 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 15:24:59.126797 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.126687 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.126869 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.126748 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-57qq8\"" Jul 15 15:24:59.127149 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.127129 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 15:24:59.127299 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.127285 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.137727 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.137700 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv"] Jul 15 15:24:59.137844 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.137747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.140210 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.140189 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.140442 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.140425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.140816 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.140802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 15:24:59.140816 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.140812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 15:24:59.141051 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.141038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tgpfl\"" Jul 15 15:24:59.147528 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.147507 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 15:24:59.152323 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-config\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.152425 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-trusted-ca\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.152425 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-snapshots\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.152425 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-tmp\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.152565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.152565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-serving-cert\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.152565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.152565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgrdn\" (UniqueName: \"kubernetes.io/projected/a00c0c57-b380-4103-abc9-e765c7daac2e-kube-api-access-rgrdn\") pod \"volume-data-source-validator-78495597f6-jm5sg\" (UID: \"a00c0c57-b380-4103-abc9-e765c7daac2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" Jul 15 15:24:59.152565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a7634a8-6d9c-4524-8cd3-4bea0679614d-config\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.152771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a7634a8-6d9c-4524-8cd3-4bea0679614d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.152771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z68qk\" (UniqueName: \"kubernetes.io/projected/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-kube-api-access-z68qk\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.152771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72184120-1f18-44ea-8be4-b503a7e1fffd-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.152771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7th\" (UniqueName: \"kubernetes.io/projected/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-kube-api-access-tc7th\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.152771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c52j\" (UniqueName: \"kubernetes.io/projected/7a7634a8-6d9c-4524-8cd3-4bea0679614d-kube-api-access-2c52j\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.152979 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvvb\" (UniqueName: \"kubernetes.io/projected/856d30db-25fd-4d5f-bcb6-1a77c42b6d90-kube-api-access-6gvvb\") pod \"network-check-source-869dcfcdcd-l64mk\" (UID: \"856d30db-25fd-4d5f-bcb6-1a77c42b6d90\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" Jul 15 15:24:59.152979 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-serving-cert\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.152979 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.152962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.155182 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.155163 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bf84888f8-pmgqc"] Jul 15 15:24:59.155286 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.155272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.157595 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.157565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 15:24:59.157690 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.157614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.157690 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.157653 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.157811 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.157797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p4lhr\"" Jul 15 15:24:59.166204 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.166182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvvb\" (UniqueName: \"kubernetes.io/projected/856d30db-25fd-4d5f-bcb6-1a77c42b6d90-kube-api-access-6gvvb\") pod \"network-check-source-869dcfcdcd-l64mk\" (UID: \"856d30db-25fd-4d5f-bcb6-1a77c42b6d90\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" Jul 15 15:24:59.166291 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.166182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgrdn\" (UniqueName: \"kubernetes.io/projected/a00c0c57-b380-4103-abc9-e765c7daac2e-kube-api-access-rgrdn\") pod \"volume-data-source-validator-78495597f6-jm5sg\" (UID: \"a00c0c57-b380-4103-abc9-e765c7daac2e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" Jul 15 15:24:59.179354 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.179328 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv"] Jul 15 15:24:59.179488 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.179447 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.181744 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.181723 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 15:24:59.181856 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.181770 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 15:24:59.181856 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.181770 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 15:24:59.181946 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.181782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7bzdb\"" Jul 15 15:24:59.182123 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.182081 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.182228 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.182143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 15:24:59.182281 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.182267 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.195631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.195604 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc"] Jul 15 15:24:59.195755 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.195641 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rc6rf"] Jul 15 15:24:59.195755 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.195669 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv"] Jul 15 15:24:59.195863 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.195812 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv"] Jul 15 15:24:59.195863 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.195839 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bf84888f8-pmgqc"] Jul 15 15:24:59.195940 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.195922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.198991 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.198972 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 15:24:59.199150 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.199132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 15:24:59.199573 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.199560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.199737 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.199708 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.200963 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.200949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8jzng\"" Jul 15 15:24:59.208738 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.208717 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr"] Jul 15 15:24:59.229721 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.229696 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr"] Jul 15 15:24:59.229854 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.229782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.232348 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.232327 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 15:24:59.233676 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.233659 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:24:59.234079 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.234062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 15:24:59.234162 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.234095 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bf4tl\"" Jul 15 15:24:59.234214 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.234175 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 15:24:59.253756 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.253756 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.253980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-config\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.253980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-stats-auth\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.253980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-default-certificate\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.253980 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.253866 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 15:24:59.253980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-trusted-ca\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.253980 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.253945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert podName:72184120-1f18-44ea-8be4-b503a7e1fffd nodeName:}" failed. No retries permitted until 2026-07-15 15:24:59.753925228 +0000 UTC m=+56.150163225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rtw7x" (UID: "72184120-1f18-44ea-8be4-b503a7e1fffd") : secret "networking-console-plugin-cert" not found Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.253988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-snapshots\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-tmp\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsqg\" (UniqueName: \"kubernetes.io/projected/166bfde5-78e1-4753-8d35-4a945452b5ef-kube-api-access-qdsqg\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-serving-cert\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.254277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a7634a8-6d9c-4524-8cd3-4bea0679614d-config\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hlgf\" (UniqueName: \"kubernetes.io/projected/6b9c7276-1361-4efd-89eb-f3bf081580e3-kube-api-access-4hlgf\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a7634a8-6d9c-4524-8cd3-4bea0679614d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/abb01889-fff5-4566-8bf0-f8eed82ce3e9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z68qk\" (UniqueName: \"kubernetes.io/projected/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-kube-api-access-z68qk\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/166bfde5-78e1-4753-8d35-4a945452b5ef-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72184120-1f18-44ea-8be4-b503a7e1fffd-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7th\" (UniqueName: \"kubernetes.io/projected/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-kube-api-access-tc7th\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c52j\" (UniqueName: \"kubernetes.io/projected/7a7634a8-6d9c-4524-8cd3-4bea0679614d-kube-api-access-2c52j\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwvj\" (UniqueName: \"kubernetes.io/projected/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-kube-api-access-rfwvj\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-serving-cert\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-config\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/166bfde5-78e1-4753-8d35-4a945452b5ef-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.254684 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szpkm\" (UniqueName: \"kubernetes.io/projected/abb01889-fff5-4566-8bf0-f8eed82ce3e9-kube-api-access-szpkm\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.255245 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254879 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a7634a8-6d9c-4524-8cd3-4bea0679614d-config\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.255245 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.254930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-trusted-ca\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.255310 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.255268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72184120-1f18-44ea-8be4-b503a7e1fffd-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.257157 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.257135 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-serving-cert\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.257275 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.257236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a7634a8-6d9c-4524-8cd3-4bea0679614d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.265845 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.265770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-tmp\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.265962 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.265923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.265962 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.265947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-snapshots\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.266219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.266202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.267671 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.267644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-serving-cert\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.267787 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.267764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7th\" (UniqueName: \"kubernetes.io/projected/db0a5b5a-26a3-4d18-a2f2-54e6954eec56-kube-api-access-tc7th\") pod \"insights-operator-68d9dd94cf-6mxld\" (UID: \"db0a5b5a-26a3-4d18-a2f2-54e6954eec56\") " pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.269264 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.269242 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c52j\" (UniqueName: \"kubernetes.io/projected/7a7634a8-6d9c-4524-8cd3-4bea0679614d-kube-api-access-2c52j\") pod \"service-ca-operator-7695fc6c8c-fqrlc\" (UID: \"7a7634a8-6d9c-4524-8cd3-4bea0679614d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.269502 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.269485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z68qk\" (UniqueName: \"kubernetes.io/projected/cab6c8f6-4bf6-4d26-a3d0-ba461c782745-kube-api-access-z68qk\") pod \"console-operator-7866497494-rc6rf\" (UID: \"cab6c8f6-4bf6-4d26-a3d0-ba461c782745\") " pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.332445 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.332405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" Jul 15 15:24:59.345586 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.345554 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" Jul 15 15:24:59.355955 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.355927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/166bfde5-78e1-4753-8d35-4a945452b5ef-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.356070 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.355968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwvj\" (UniqueName: \"kubernetes.io/projected/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-kube-api-access-rfwvj\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.356070 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.355988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.356070 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/166bfde5-78e1-4753-8d35-4a945452b5ef-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.356070 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szpkm\" (UniqueName: \"kubernetes.io/projected/abb01889-fff5-4566-8bf0-f8eed82ce3e9-kube-api-access-szpkm\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.356258 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.356258 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356120 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:59.856100327 +0000 UTC m=+56.252338343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : configmap references non-existent config key: service-ca.crt Jul 15 15:24:59.356258 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356162 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 15:24:59.356258 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356210 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls podName:c4f59b5b-5b38-46c4-90c7-02a24aaec1e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:59.856198256 +0000 UTC m=+56.252436258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls") pod "cluster-samples-operator-65db858894-r6kvv" (UID: "c4f59b5b-5b38-46c4-90c7-02a24aaec1e9") : secret "samples-operator-tls" not found Jul 15 15:24:59.356457 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-stats-auth\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.356457 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-default-certificate\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.356457 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.356457 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsqg\" (UniqueName: \"kubernetes.io/projected/166bfde5-78e1-4753-8d35-4a945452b5ef-kube-api-access-qdsqg\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.356457 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hlgf\" (UniqueName: \"kubernetes.io/projected/6b9c7276-1361-4efd-89eb-f3bf081580e3-kube-api-access-4hlgf\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.356711 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.356711 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/abb01889-fff5-4566-8bf0-f8eed82ce3e9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.356711 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356516 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 15:24:59.356711 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356579 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:59.856562173 +0000 UTC m=+56.252800167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : secret "router-metrics-certs-default" not found Jul 15 15:24:59.356711 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.356646 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/166bfde5-78e1-4753-8d35-4a945452b5ef-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.356905 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356746 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 15:24:59.356905 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.356811 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls podName:abb01889-fff5-4566-8bf0-f8eed82ce3e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:24:59.856796728 +0000 UTC m=+56.253034722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bp6fv" (UID: "abb01889-fff5-4566-8bf0-f8eed82ce3e9") : secret "cluster-monitoring-operator-tls" not found Jul 15 15:24:59.357250 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.357231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/abb01889-fff5-4566-8bf0-f8eed82ce3e9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.358832 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.358807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-stats-auth\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.359017 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.358997 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/166bfde5-78e1-4753-8d35-4a945452b5ef-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.359092 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.359076 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-default-certificate\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.365938 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.365915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szpkm\" (UniqueName: \"kubernetes.io/projected/abb01889-fff5-4566-8bf0-f8eed82ce3e9-kube-api-access-szpkm\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.367704 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.367683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwvj\" (UniqueName: \"kubernetes.io/projected/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-kube-api-access-rfwvj\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.367704 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.367698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsqg\" (UniqueName: \"kubernetes.io/projected/166bfde5-78e1-4753-8d35-4a945452b5ef-kube-api-access-qdsqg\") pod \"kube-storage-version-migrator-operator-799cb7f958-7pscr\" (UID: \"166bfde5-78e1-4753-8d35-4a945452b5ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.368083 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.368064 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hlgf\" (UniqueName: \"kubernetes.io/projected/6b9c7276-1361-4efd-89eb-f3bf081580e3-kube-api-access-4hlgf\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.395326 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.395295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" Jul 15 15:24:59.436264 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.436045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" Jul 15 15:24:59.456214 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.449332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:24:59.504829 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.504712 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk"] Jul 15 15:24:59.509505 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:59.509434 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856d30db_25fd_4d5f_bcb6_1a77c42b6d90.slice/crio-5805fd72593a51d0848daba869597daf4ce9f9f2a5bf12ed10f6c710e48c906e WatchSource:0}: Error finding container 5805fd72593a51d0848daba869597daf4ce9f9f2a5bf12ed10f6c710e48c906e: Status 404 returned error can't find the container with id 5805fd72593a51d0848daba869597daf4ce9f9f2a5bf12ed10f6c710e48c906e Jul 15 15:24:59.534417 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.534333 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg"] Jul 15 15:24:59.538712 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.538682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" Jul 15 15:24:59.540582 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:59.540544 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00c0c57_b380_4103_abc9_e765c7daac2e.slice/crio-02246f5b33c7263544e49c125c4ac3b7cd4fd440bbd940bb694e6041beab769e WatchSource:0}: Error finding container 02246f5b33c7263544e49c125c4ac3b7cd4fd440bbd940bb694e6041beab769e: Status 404 returned error can't find the container with id 02246f5b33c7263544e49c125c4ac3b7cd4fd440bbd940bb694e6041beab769e Jul 15 15:24:59.594485 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.594390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6mxld"] Jul 15 15:24:59.600078 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:59.600042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0a5b5a_26a3_4d18_a2f2_54e6954eec56.slice/crio-77067fc5c8f6d76f0ec3cb8d9c2a399ad338fc31a28068e0413d7ffe7761beb6 WatchSource:0}: Error finding container 77067fc5c8f6d76f0ec3cb8d9c2a399ad338fc31a28068e0413d7ffe7761beb6: Status 404 returned error can't find the container with id 77067fc5c8f6d76f0ec3cb8d9c2a399ad338fc31a28068e0413d7ffe7761beb6 Jul 15 15:24:59.618178 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.618148 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc"] Jul 15 15:24:59.621344 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:59.621319 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7634a8_6d9c_4524_8cd3_4bea0679614d.slice/crio-336b881a9980649c0d4c63d025fe9bf8c037e06b1615eca082ed205220f8e201 WatchSource:0}: Error finding container 336b881a9980649c0d4c63d025fe9bf8c037e06b1615eca082ed205220f8e201: Status 404 returned error can't find the container with id 336b881a9980649c0d4c63d025fe9bf8c037e06b1615eca082ed205220f8e201 Jul 15 15:24:59.631379 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.631316 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rc6rf"] Jul 15 15:24:59.636302 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:59.636255 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab6c8f6_4bf6_4d26_a3d0_ba461c782745.slice/crio-881685f3375876356364f5501d01affb8f2d213684fed5c157d2792b76b00221 WatchSource:0}: Error finding container 881685f3375876356364f5501d01affb8f2d213684fed5c157d2792b76b00221: Status 404 returned error can't find the container with id 881685f3375876356364f5501d01affb8f2d213684fed5c157d2792b76b00221 Jul 15 15:24:59.713139 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.713105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr"] Jul 15 15:24:59.716673 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:24:59.716651 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166bfde5_78e1_4753_8d35_4a945452b5ef.slice/crio-da0ddf75fcf1ec32a57c574c48f0d7f6a86beca690dde4b93e2592968db2223a WatchSource:0}: Error finding container da0ddf75fcf1ec32a57c574c48f0d7f6a86beca690dde4b93e2592968db2223a: Status 404 returned error can't find the container with id da0ddf75fcf1ec32a57c574c48f0d7f6a86beca690dde4b93e2592968db2223a Jul 15 15:24:59.760996 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.760961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:24:59.761159 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.761137 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 15:24:59.761244 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.761216 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert podName:72184120-1f18-44ea-8be4-b503a7e1fffd nodeName:}" failed. No retries permitted until 2026-07-15 15:25:00.761195809 +0000 UTC m=+57.157433803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rtw7x" (UID: "72184120-1f18-44ea-8be4-b503a7e1fffd") : secret "networking-console-plugin-cert" not found Jul 15 15:24:59.861383 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.861347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.861553 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.861409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:24:59.861553 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.861481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:24:59.861553 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.861520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:24:59.861657 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861550 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:00.861528514 +0000 UTC m=+57.257766508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : configmap references non-existent config key: service-ca.crt Jul 15 15:24:59.861657 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861561 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 15:24:59.861657 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861609 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls podName:c4f59b5b-5b38-46c4-90c7-02a24aaec1e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:00.861594572 +0000 UTC m=+57.257832578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls") pod "cluster-samples-operator-65db858894-r6kvv" (UID: "c4f59b5b-5b38-46c4-90c7-02a24aaec1e9") : secret "samples-operator-tls" not found Jul 15 15:24:59.861657 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861638 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 15:24:59.861778 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861693 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 15:24:59.861778 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861695 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:00.861679512 +0000 UTC m=+57.257917524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : secret "router-metrics-certs-default" not found Jul 15 15:24:59.861778 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:24:59.861736 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls podName:abb01889-fff5-4566-8bf0-f8eed82ce3e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:00.861727733 +0000 UTC m=+57.257965729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bp6fv" (UID: "abb01889-fff5-4566-8bf0-f8eed82ce3e9") : secret "cluster-monitoring-operator-tls" not found Jul 15 15:24:59.999303 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:24:59.999270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" event={"ID":"a00c0c57-b380-4103-abc9-e765c7daac2e","Type":"ContainerStarted","Data":"02246f5b33c7263544e49c125c4ac3b7cd4fd440bbd940bb694e6041beab769e"} Jul 15 15:25:00.000380 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.000355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" event={"ID":"7a7634a8-6d9c-4524-8cd3-4bea0679614d","Type":"ContainerStarted","Data":"336b881a9980649c0d4c63d025fe9bf8c037e06b1615eca082ed205220f8e201"} Jul 15 15:25:00.001401 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.001380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" event={"ID":"856d30db-25fd-4d5f-bcb6-1a77c42b6d90","Type":"ContainerStarted","Data":"5805fd72593a51d0848daba869597daf4ce9f9f2a5bf12ed10f6c710e48c906e"} Jul 15 15:25:00.002403 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.002378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" event={"ID":"166bfde5-78e1-4753-8d35-4a945452b5ef","Type":"ContainerStarted","Data":"da0ddf75fcf1ec32a57c574c48f0d7f6a86beca690dde4b93e2592968db2223a"} Jul 15 15:25:00.003339 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.003318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rc6rf" event={"ID":"cab6c8f6-4bf6-4d26-a3d0-ba461c782745","Type":"ContainerStarted","Data":"881685f3375876356364f5501d01affb8f2d213684fed5c157d2792b76b00221"} Jul 15 15:25:00.004270 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.004248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" event={"ID":"db0a5b5a-26a3-4d18-a2f2-54e6954eec56","Type":"ContainerStarted","Data":"77067fc5c8f6d76f0ec3cb8d9c2a399ad338fc31a28068e0413d7ffe7761beb6"} Jul 15 15:25:00.769608 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.769245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:00.770881 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.770326 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 15:25:00.770881 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.770418 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert podName:72184120-1f18-44ea-8be4-b503a7e1fffd nodeName:}" failed. No retries permitted until 2026-07-15 15:25:02.770396119 +0000 UTC m=+59.166634138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rtw7x" (UID: "72184120-1f18-44ea-8be4-b503a7e1fffd") : secret "networking-console-plugin-cert" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.870700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.870796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.870856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:00.870946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871093 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871157 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:02.871137079 +0000 UTC m=+59.267375093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : secret "router-metrics-certs-default" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871165 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871190 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871204 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls podName:c4f59b5b-5b38-46c4-90c7-02a24aaec1e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:02.871192661 +0000 UTC m=+59.267430667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls") pod "cluster-samples-operator-65db858894-r6kvv" (UID: "c4f59b5b-5b38-46c4-90c7-02a24aaec1e9") : secret "samples-operator-tls" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871261 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls podName:abb01889-fff5-4566-8bf0-f8eed82ce3e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:02.871251558 +0000 UTC m=+59.267489558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bp6fv" (UID: "abb01889-fff5-4566-8bf0-f8eed82ce3e9") : secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:00.871531 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:00.871284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:02.871275556 +0000 UTC m=+59.267513556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : configmap references non-existent config key: service-ca.crt Jul 15 15:25:02.015029 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.014984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" event={"ID":"a00c0c57-b380-4103-abc9-e765c7daac2e","Type":"ContainerStarted","Data":"360b5aedfa79fc4f5511e5a2938a3d100624bafd1b64e97e8117534234d2e315"} Jul 15 15:25:02.032168 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.032108 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jm5sg" podStartSLOduration=2.426832201 podStartE2EDuration="4.032089347s" totalImagesPullingTime="1.605257146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:02.030774313 +0000 UTC m=+58.427012333" watchObservedRunningTime="2026-07-15 15:25:02.032089347 +0000 UTC m=+58.428327362" Jul 15 15:25:02.790682 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.790646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:02.790955 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.790829 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 15:25:02.790955 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.790905 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert podName:72184120-1f18-44ea-8be4-b503a7e1fffd nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.790883508 +0000 UTC m=+63.187121506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rtw7x" (UID: "72184120-1f18-44ea-8be4-b503a7e1fffd") : secret "networking-console-plugin-cert" not found Jul 15 15:25:02.892212 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.892169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:25:02.892405 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892344 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 15:25:02.892405 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.892359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:02.892555 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892424 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls podName:c4f59b5b-5b38-46c4-90c7-02a24aaec1e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.892400469 +0000 UTC m=+63.288638477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls") pod "cluster-samples-operator-65db858894-r6kvv" (UID: "c4f59b5b-5b38-46c4-90c7-02a24aaec1e9") : secret "samples-operator-tls" not found Jul 15 15:25:02.892555 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.892451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:02.892555 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892481 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 15:25:02.892555 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892531 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.892516624 +0000 UTC m=+63.288754620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : secret "router-metrics-certs-default" not found Jul 15 15:25:02.892770 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:02.892558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:02.892770 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892581 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:02.892770 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892626 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls podName:abb01889-fff5-4566-8bf0-f8eed82ce3e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.892612061 +0000 UTC m=+63.288850071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bp6fv" (UID: "abb01889-fff5-4566-8bf0-f8eed82ce3e9") : secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:02.892770 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:02.892656 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:06.892647361 +0000 UTC m=+63.288885378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : configmap references non-existent config key: service-ca.crt Jul 15 15:25:05.027146 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.027105 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" event={"ID":"856d30db-25fd-4d5f-bcb6-1a77c42b6d90","Type":"ContainerStarted","Data":"20ae77fa15ab4eae5a652e0c2b5783b898a770e67578723ff98a5f650129cbf2"} Jul 15 15:25:05.028833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.028792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" event={"ID":"166bfde5-78e1-4753-8d35-4a945452b5ef","Type":"ContainerStarted","Data":"b11b9c13affc5de657d51ed47103a228e6ef073f5b6dbd52dd625c737b9eaf36"} Jul 15 15:25:05.030648 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.030627 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/0.log" Jul 15 15:25:05.030759 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.030669 2578 generic.go:356] "Generic (PLEG): container finished" podID="cab6c8f6-4bf6-4d26-a3d0-ba461c782745" containerID="edb602f11a1ef0b95da1e2e6dbae8d0d49c008029b774dc65c2fe42f6894210e" exitCode=255 Jul 15 15:25:05.030835 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.030753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rc6rf" event={"ID":"cab6c8f6-4bf6-4d26-a3d0-ba461c782745","Type":"ContainerDied","Data":"edb602f11a1ef0b95da1e2e6dbae8d0d49c008029b774dc65c2fe42f6894210e"} Jul 15 15:25:05.030916 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.030900 2578 scope.go:117] "RemoveContainer" containerID="edb602f11a1ef0b95da1e2e6dbae8d0d49c008029b774dc65c2fe42f6894210e" Jul 15 15:25:05.032850 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.032825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" event={"ID":"db0a5b5a-26a3-4d18-a2f2-54e6954eec56","Type":"ContainerStarted","Data":"c6afcf9b73f2a20ef50347e256b27b34b9d8fcb1ca14aa614b8821179d925524"} Jul 15 15:25:05.034783 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.034761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" event={"ID":"7a7634a8-6d9c-4524-8cd3-4bea0679614d","Type":"ContainerStarted","Data":"dde54015457424b763fd393227fab0ecd1aed60650b32be3631ddb419812d076"} Jul 15 15:25:05.066838 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.066745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-l64mk" podStartSLOduration=1.992122026 podStartE2EDuration="7.066722706s" totalImagesPullingTime="5.07460068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:05.047318545 +0000 UTC m=+61.443556562" watchObservedRunningTime="2026-07-15 15:25:05.066722706 +0000 UTC m=+61.462960719" Jul 15 15:25:05.084109 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.084063 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" podStartSLOduration=1.134239719 podStartE2EDuration="6.084044762s" totalImagesPullingTime="4.949805043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:05.065681254 +0000 UTC m=+61.461919262" watchObservedRunningTime="2026-07-15 15:25:05.084044762 +0000 UTC m=+61.480282780" Jul 15 15:25:05.105798 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.105741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" podStartSLOduration=2.128717596 podStartE2EDuration="7.105722958s" totalImagesPullingTime="4.977005362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:05.10486168 +0000 UTC m=+61.501099705" watchObservedRunningTime="2026-07-15 15:25:05.105722958 +0000 UTC m=+61.501960978" Jul 15 15:25:05.125762 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:05.125693 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" podStartSLOduration=1.264550665 podStartE2EDuration="6.1256717s" totalImagesPullingTime="4.861121035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:05.124888851 +0000 UTC m=+61.521126862" watchObservedRunningTime="2026-07-15 15:25:05.1256717 +0000 UTC m=+61.521909718" Jul 15 15:25:06.040600 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.040568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:25:06.041035 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.041027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/0.log" Jul 15 15:25:06.041084 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.041063 2578 generic.go:356] "Generic (PLEG): container finished" podID="cab6c8f6-4bf6-4d26-a3d0-ba461c782745" containerID="7c5f78ccc6efa86049faa38f2a8eb17cdf83a0b2d2a8cc1df5cc8fe5244eaf73" exitCode=255 Jul 15 15:25:06.041372 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.041126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rc6rf" event={"ID":"cab6c8f6-4bf6-4d26-a3d0-ba461c782745","Type":"ContainerDied","Data":"7c5f78ccc6efa86049faa38f2a8eb17cdf83a0b2d2a8cc1df5cc8fe5244eaf73"} Jul 15 15:25:06.041372 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.041191 2578 scope.go:117] "RemoveContainer" containerID="edb602f11a1ef0b95da1e2e6dbae8d0d49c008029b774dc65c2fe42f6894210e" Jul 15 15:25:06.041552 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.041418 2578 scope.go:117] "RemoveContainer" containerID="7c5f78ccc6efa86049faa38f2a8eb17cdf83a0b2d2a8cc1df5cc8fe5244eaf73" Jul 15 15:25:06.041842 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.041616 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rc6rf_openshift-console-operator(cab6c8f6-4bf6-4d26-a3d0-ba461c782745)\"" pod="openshift-console-operator/console-operator-7866497494-rc6rf" podUID="cab6c8f6-4bf6-4d26-a3d0-ba461c782745" Jul 15 15:25:06.728388 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.728351 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gn277"] Jul 15 15:25:06.753246 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.753218 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gn277"] Jul 15 15:25:06.753401 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.753332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.756762 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.756539 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 15:25:06.756762 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.756588 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-92ld7\"" Jul 15 15:25:06.756949 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.756856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 15:25:06.831606 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.831576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47cf9a99-da95-4506-bccf-d64e2918e96a-data-volume\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.831798 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.831617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.831798 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.831658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65sn\" (UniqueName: \"kubernetes.io/projected/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-api-access-d65sn\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.831798 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.831735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:06.831958 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.831803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47cf9a99-da95-4506-bccf-d64e2918e96a-crio-socket\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.831958 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.831850 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 15:25:06.831958 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.831868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.831958 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.831920 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert podName:72184120-1f18-44ea-8be4-b503a7e1fffd nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.831901929 +0000 UTC m=+71.228139937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rtw7x" (UID: "72184120-1f18-44ea-8be4-b503a7e1fffd") : secret "networking-console-plugin-cert" not found Jul 15 15:25:06.933073 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47cf9a99-da95-4506-bccf-d64e2918e96a-crio-socket\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933193 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47cf9a99-da95-4506-bccf-d64e2918e96a-data-volume\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933245 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47cf9a99-da95-4506-bccf-d64e2918e96a-crio-socket\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.933251 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933257 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls podName:c4f59b5b-5b38-46c4-90c7-02a24aaec1e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.933241449 +0000 UTC m=+71.329479443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls") pod "cluster-samples-operator-65db858894-r6kvv" (UID: "c4f59b5b-5b38-46c4-90c7-02a24aaec1e9") : secret "samples-operator-tls" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933287 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933296 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65sn\" (UniqueName: \"kubernetes.io/projected/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-api-access-d65sn\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933345 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933355 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933379 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:07.433360635 +0000 UTC m=+63.829598643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : secret "insights-runtime-extractor-tls" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933403 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls podName:abb01889-fff5-4566-8bf0-f8eed82ce3e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.933392646 +0000 UTC m=+71.329630640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bp6fv" (UID: "abb01889-fff5-4566-8bf0-f8eed82ce3e9") : secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933423 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:07.433413892 +0000 UTC m=+63.829651888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : configmap "kube-rbac-proxy" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.933431109 +0000 UTC m=+71.329669118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : secret "router-metrics-certs-default" not found Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:06.933529 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.93351245 +0000 UTC m=+71.329750459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : configmap references non-existent config key: service-ca.crt Jul 15 15:25:06.933656 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.933568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47cf9a99-da95-4506-bccf-d64e2918e96a-data-volume\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:06.941406 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:06.941383 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65sn\" (UniqueName: \"kubernetes.io/projected/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-api-access-d65sn\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:07.048186 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:07.048105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:25:07.048563 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:07.048457 2578 scope.go:117] "RemoveContainer" containerID="7c5f78ccc6efa86049faa38f2a8eb17cdf83a0b2d2a8cc1df5cc8fe5244eaf73" Jul 15 15:25:07.048654 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:07.048635 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rc6rf_openshift-console-operator(cab6c8f6-4bf6-4d26-a3d0-ba461c782745)\"" pod="openshift-console-operator/console-operator-7866497494-rc6rf" podUID="cab6c8f6-4bf6-4d26-a3d0-ba461c782745" Jul 15 15:25:07.438791 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:07.438703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:07.438941 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:07.438829 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:25:07.438941 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:07.438843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:07.438941 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:07.438891 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:08.438873592 +0000 UTC m=+64.835111589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : configmap "kube-rbac-proxy" not found Jul 15 15:25:07.439055 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:07.438952 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:25:07.439055 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:07.438999 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:08.438985449 +0000 UTC m=+64.835223446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : secret "insights-runtime-extractor-tls" not found Jul 15 15:25:07.949557 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:07.949530 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjvh7" Jul 15 15:25:08.449109 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:08.449068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:08.449493 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:08.449135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:08.449493 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:08.449213 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:25:08.449493 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:08.449294 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:25:08.449493 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:08.449296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:10.44927391 +0000 UTC m=+66.845511904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : configmap "kube-rbac-proxy" not found Jul 15 15:25:08.449493 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:08.449345 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:10.449333531 +0000 UTC m=+66.845571536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : secret "insights-runtime-extractor-tls" not found Jul 15 15:25:09.320028 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.320003 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x88n8_eb7b119e-8b61-4544-af4f-41f460f2469c/dns-node-resolver/0.log" Jul 15 15:25:09.450198 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.450164 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:25:09.450600 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.450225 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:25:09.450600 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.450575 2578 scope.go:117] "RemoveContainer" containerID="7c5f78ccc6efa86049faa38f2a8eb17cdf83a0b2d2a8cc1df5cc8fe5244eaf73" Jul 15 15:25:09.450750 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:09.450731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rc6rf_openshift-console-operator(cab6c8f6-4bf6-4d26-a3d0-ba461c782745)\"" pod="openshift-console-operator/console-operator-7866497494-rc6rf" podUID="cab6c8f6-4bf6-4d26-a3d0-ba461c782745" Jul 15 15:25:09.862222 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.862180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:25:09.865496 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.865457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 15:25:09.874860 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.874828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb418a97-fe69-4a50-9015-404b32a84be7-original-pull-secret\") pod \"global-pull-secret-syncer-6dmst\" (UID: \"fb418a97-fe69-4a50-9015-404b32a84be7\") " pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:25:09.963410 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.963373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:25:09.963601 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.963434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:25:09.965886 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.965858 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjj4\" (UniqueName: \"kubernetes.io/projected/92c73c32-616c-478b-a719-c60e7ffabd37-kube-api-access-fkjj4\") pod \"network-check-target-mhlcd\" (UID: \"92c73c32-616c-478b-a719-c60e7ffabd37\") " pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:25:09.966332 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.966316 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 15:25:09.974717 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:09.974688 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 15:25:09.974815 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:09.974758 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs podName:f1e695ec-b4be-4a8b-b47e-8eed3ba65faf nodeName:}" failed. No retries permitted until 2026-07-15 15:26:13.97474226 +0000 UTC m=+130.370980253 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs") pod "network-metrics-daemon-z75wl" (UID: "f1e695ec-b4be-4a8b-b47e-8eed3ba65faf") : secret "metrics-daemon-secret" not found Jul 15 15:25:09.993826 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:09.993798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h9ndf\"" Jul 15 15:25:10.001864 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.001843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:25:10.082810 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.082785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6dmst" Jul 15 15:25:10.137677 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.137646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhlcd"] Jul 15 15:25:10.143089 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:10.143064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c73c32_616c_478b_a719_c60e7ffabd37.slice/crio-39ea7feac5a40ea90ae645de1a409b1e5ee7880aa243b7cb8091830f35b2c7d8 WatchSource:0}: Error finding container 39ea7feac5a40ea90ae645de1a409b1e5ee7880aa243b7cb8091830f35b2c7d8: Status 404 returned error can't find the container with id 39ea7feac5a40ea90ae645de1a409b1e5ee7880aa243b7cb8091830f35b2c7d8 Jul 15 15:25:10.216806 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.216783 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6dmst"] Jul 15 15:25:10.219072 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:10.219042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb418a97_fe69_4a50_9015_404b32a84be7.slice/crio-24edcff2b0fc9790c4051663fffc3f4aafbde2a202de1d1cc18ee6161566d3c1 WatchSource:0}: Error finding container 24edcff2b0fc9790c4051663fffc3f4aafbde2a202de1d1cc18ee6161566d3c1: Status 404 returned error can't find the container with id 24edcff2b0fc9790c4051663fffc3f4aafbde2a202de1d1cc18ee6161566d3c1 Jul 15 15:25:10.320575 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.320547 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zp67h_a439729b-98ab-4fdb-b9fb-b5384c0a1588/node-ca/0.log" Jul 15 15:25:10.469133 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.469097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:10.469583 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.469166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:10.469583 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:10.469280 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:25:10.469583 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:10.469300 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:25:10.469583 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:10.469341 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.469324355 +0000 UTC m=+70.865562353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : configmap "kube-rbac-proxy" not found Jul 15 15:25:10.469583 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:10.469367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:14.469347699 +0000 UTC m=+70.865585696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : secret "insights-runtime-extractor-tls" not found Jul 15 15:25:10.914573 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:10.914492 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sv5mr_5e259c1b-9c11-4422-a13f-9d386d07a847/serve-healthcheck-canary/0.log" Jul 15 15:25:11.060796 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:11.060765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6dmst" event={"ID":"fb418a97-fe69-4a50-9015-404b32a84be7","Type":"ContainerStarted","Data":"24edcff2b0fc9790c4051663fffc3f4aafbde2a202de1d1cc18ee6161566d3c1"} Jul 15 15:25:11.062077 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:11.062051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhlcd" event={"ID":"92c73c32-616c-478b-a719-c60e7ffabd37","Type":"ContainerStarted","Data":"df6684ca0790efc0f1036e08f250a832e47d48ffbf64b566019df151b94bc0b0"} Jul 15 15:25:11.062194 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:11.062095 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhlcd" event={"ID":"92c73c32-616c-478b-a719-c60e7ffabd37","Type":"ContainerStarted","Data":"39ea7feac5a40ea90ae645de1a409b1e5ee7880aa243b7cb8091830f35b2c7d8"} Jul 15 15:25:11.062275 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:11.062196 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:25:11.084788 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:11.084708 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mhlcd" podStartSLOduration=66.08469259 podStartE2EDuration="1m6.08469259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:11.082994815 +0000 UTC m=+67.479232834" watchObservedRunningTime="2026-07-15 15:25:11.08469259 +0000 UTC m=+67.480930606" Jul 15 15:25:11.519296 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:11.519260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7pscr_166bfde5-78e1-4753-8d35-4a945452b5ef/kube-storage-version-migrator-operator/0.log" Jul 15 15:25:12.791121 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:12.791084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:25:12.791608 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:12.791266 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 15:25:12.791608 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:12.791290 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d8f4f569-rhfqw: secret "image-registry-tls" not found Jul 15 15:25:12.791608 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:12.791360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls podName:5e934a77-7ff4-4554-8e57-cf7b679e03c6 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:44.791340173 +0000 UTC m=+101.187578184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls") pod "image-registry-76d8f4f569-rhfqw" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6") : secret "image-registry-tls" not found Jul 15 15:25:12.891779 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:12.891747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:25:12.891945 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:12.891916 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 15:25:12.892008 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:12.892001 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls podName:55a995c9-c058-4dd7-9dc4-4a7dd887349d nodeName:}" failed. No retries permitted until 2026-07-15 15:25:44.891981965 +0000 UTC m=+101.288219963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls") pod "dns-default-w4tqc" (UID: "55a995c9-c058-4dd7-9dc4-4a7dd887349d") : secret "dns-default-metrics-tls" not found Jul 15 15:25:14.506837 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:14.506800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:14.507409 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:14.506868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:14.507409 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:14.506977 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:25:14.507409 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:14.507005 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 15:25:14.507409 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:14.507063 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:22.507041952 +0000 UTC m=+78.903279964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : secret "insights-runtime-extractor-tls" not found Jul 15 15:25:14.507409 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:14.507112 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:22.507092038 +0000 UTC m=+78.903330036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : configmap "kube-rbac-proxy" not found Jul 15 15:25:14.910990 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:14.910909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:14.911136 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:14.911070 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 15:25:14.911179 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:14.911137 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert podName:72184120-1f18-44ea-8be4-b503a7e1fffd nodeName:}" failed. No retries permitted until 2026-07-15 15:25:30.911121377 +0000 UTC m=+87.307359371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rtw7x" (UID: "72184120-1f18-44ea-8be4-b503a7e1fffd") : secret "networking-console-plugin-cert" not found Jul 15 15:25:15.012241 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.012205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:15.012413 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.012256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:25:15.012413 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.012311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:15.012413 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.012348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:15.012413 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:15.012370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:31.012350848 +0000 UTC m=+87.408588841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : configmap references non-existent config key: service-ca.crt Jul 15 15:25:15.012632 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:15.012439 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 15:25:15.012632 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:15.012505 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:15.012632 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:15.012526 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs podName:6b9c7276-1361-4efd-89eb-f3bf081580e3 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:31.012505109 +0000 UTC m=+87.408743123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs") pod "router-default-bf84888f8-pmgqc" (UID: "6b9c7276-1361-4efd-89eb-f3bf081580e3") : secret "router-metrics-certs-default" not found Jul 15 15:25:15.012632 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:15.012555 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls podName:abb01889-fff5-4566-8bf0-f8eed82ce3e9 nodeName:}" failed. No retries permitted until 2026-07-15 15:25:31.012537697 +0000 UTC m=+87.408775693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bp6fv" (UID: "abb01889-fff5-4566-8bf0-f8eed82ce3e9") : secret "cluster-monitoring-operator-tls" not found Jul 15 15:25:15.014763 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.014741 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4f59b5b-5b38-46c4-90c7-02a24aaec1e9-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-r6kvv\" (UID: \"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:25:15.067132 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.067103 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p4lhr\"" Jul 15 15:25:15.074254 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.074231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" Jul 15 15:25:15.410324 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:15.410296 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv"] Jul 15 15:25:16.079556 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:16.079512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6dmst" event={"ID":"fb418a97-fe69-4a50-9015-404b32a84be7","Type":"ContainerStarted","Data":"2a6ebed515ab2da41da77758272d3c0f8bdad1fc43072d50d9ca1bd941c4c703"} Jul 15 15:25:16.080671 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:16.080647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" event={"ID":"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9","Type":"ContainerStarted","Data":"4bfa7c28c4f9592718e955f0f48bc8f14defe372813d1126c1efbc951b7b4a01"} Jul 15 15:25:16.098732 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:16.098690 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6dmst" podStartSLOduration=66.033536283 podStartE2EDuration="1m11.098674884s" totalImagesPullingTime="5.065138601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:16.097823746 +0000 UTC m=+72.494061762" watchObservedRunningTime="2026-07-15 15:25:16.098674884 +0000 UTC m=+72.494912900" Jul 15 15:25:18.088486 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:18.088429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" event={"ID":"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9","Type":"ContainerStarted","Data":"0bfedbfe83d18ecab33bdbd992cfdb5f758e4b32f00f45461f715b074f1c9482"} Jul 15 15:25:18.088855 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:18.088508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" event={"ID":"c4f59b5b-5b38-46c4-90c7-02a24aaec1e9","Type":"ContainerStarted","Data":"1da5e5ffa4080c2dacf9afcff3149f9adf7687165bb2c720119c0827b19403ac"} Jul 15 15:25:18.106333 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:18.106280 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-r6kvv" podStartSLOduration=16.899892628 podStartE2EDuration="19.106262965s" totalImagesPullingTime="2.206370337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:18.105403111 +0000 UTC m=+74.501641128" watchObservedRunningTime="2026-07-15 15:25:18.106262965 +0000 UTC m=+74.502500980" Jul 15 15:25:21.775594 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:21.775565 2578 scope.go:117] "RemoveContainer" containerID="7c5f78ccc6efa86049faa38f2a8eb17cdf83a0b2d2a8cc1df5cc8fe5244eaf73" Jul 15 15:25:22.103574 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.103499 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:25:22.103716 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.103574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rc6rf" event={"ID":"cab6c8f6-4bf6-4d26-a3d0-ba461c782745","Type":"ContainerStarted","Data":"2b863b6d391a0c63070e003d1400f147646196c70fba006a0568ef8bc95c9278"} Jul 15 15:25:22.103881 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.103862 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:25:22.126540 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.126491 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-rc6rf" podStartSLOduration=18.187850606 podStartE2EDuration="23.126461198s" totalImagesPullingTime="4.938610592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:22.123896287 +0000 UTC m=+78.520134303" watchObservedRunningTime="2026-07-15 15:25:22.126461198 +0000 UTC m=+78.522699214" Jul 15 15:25:22.583248 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.583214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:22.583429 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.583281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:22.583429 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:22.583366 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 15:25:22.583544 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:22.583434 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls podName:47cf9a99-da95-4506-bccf-d64e2918e96a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:38.583418641 +0000 UTC m=+94.979656639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gn277" (UID: "47cf9a99-da95-4506-bccf-d64e2918e96a") : secret "insights-runtime-extractor-tls" not found Jul 15 15:25:22.583941 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.583921 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47cf9a99-da95-4506-bccf-d64e2918e96a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:22.625971 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:22.625943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-rc6rf" Jul 15 15:25:29.022756 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.022636 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-b5r6x"] Jul 15 15:25:29.026621 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.026597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:29.029769 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.029745 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 15:25:29.029912 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.029864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 15:25:29.029998 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.029984 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2nhjf\"" Jul 15 15:25:29.042623 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.042599 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-b5r6x"] Jul 15 15:25:29.140664 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.140628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2wzk\" (UniqueName: \"kubernetes.io/projected/27216988-e5c2-4e8f-9c08-05cfa7a1c64a-kube-api-access-c2wzk\") pod \"downloads-68c9cbb497-b5r6x\" (UID: \"27216988-e5c2-4e8f-9c08-05cfa7a1c64a\") " pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:29.241282 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.241252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2wzk\" (UniqueName: \"kubernetes.io/projected/27216988-e5c2-4e8f-9c08-05cfa7a1c64a-kube-api-access-c2wzk\") pod \"downloads-68c9cbb497-b5r6x\" (UID: \"27216988-e5c2-4e8f-9c08-05cfa7a1c64a\") " pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:29.253201 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.253168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2wzk\" (UniqueName: \"kubernetes.io/projected/27216988-e5c2-4e8f-9c08-05cfa7a1c64a-kube-api-access-c2wzk\") pod \"downloads-68c9cbb497-b5r6x\" (UID: \"27216988-e5c2-4e8f-9c08-05cfa7a1c64a\") " pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:29.336745 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.336649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:29.481751 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:29.481572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-b5r6x"] Jul 15 15:25:29.484122 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:29.484091 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27216988_e5c2_4e8f_9c08_05cfa7a1c64a.slice/crio-8c32ae306485b1e55258b418720f9eb575433bc69612dc56d506dde1fbb69e40 WatchSource:0}: Error finding container 8c32ae306485b1e55258b418720f9eb575433bc69612dc56d506dde1fbb69e40: Status 404 returned error can't find the container with id 8c32ae306485b1e55258b418720f9eb575433bc69612dc56d506dde1fbb69e40 Jul 15 15:25:30.130746 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:30.130707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-b5r6x" event={"ID":"27216988-e5c2-4e8f-9c08-05cfa7a1c64a","Type":"ContainerStarted","Data":"8c32ae306485b1e55258b418720f9eb575433bc69612dc56d506dde1fbb69e40"} Jul 15 15:25:30.955885 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:30.955844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:30.958219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:30.958198 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72184120-1f18-44ea-8be4-b503a7e1fffd-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rtw7x\" (UID: \"72184120-1f18-44ea-8be4-b503a7e1fffd\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:31.056200 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.056160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:31.056342 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.056252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:31.056342 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.056293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:31.056843 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.056814 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b9c7276-1361-4efd-89eb-f3bf081580e3-service-ca-bundle\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:31.058725 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.058706 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7276-1361-4efd-89eb-f3bf081580e3-metrics-certs\") pod \"router-default-bf84888f8-pmgqc\" (UID: \"6b9c7276-1361-4efd-89eb-f3bf081580e3\") " pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:31.058853 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.058833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abb01889-fff5-4566-8bf0-f8eed82ce3e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bp6fv\" (UID: \"abb01889-fff5-4566-8bf0-f8eed82ce3e9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:31.169726 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.169693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w9djq\"" Jul 15 15:25:31.177987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.177950 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" Jul 15 15:25:31.291829 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.291804 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7bzdb\"" Jul 15 15:25:31.300079 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.300048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:31.309886 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.309863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8jzng\"" Jul 15 15:25:31.318000 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.317967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" Jul 15 15:25:31.328876 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.328851 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rtw7x"] Jul 15 15:25:31.331188 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:31.331159 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72184120_1f18_44ea_8be4_b503a7e1fffd.slice/crio-4498035c917c1c341a4968b592ae71ce0933349baabbb2092be762575eac5ab6 WatchSource:0}: Error finding container 4498035c917c1c341a4968b592ae71ce0933349baabbb2092be762575eac5ab6: Status 404 returned error can't find the container with id 4498035c917c1c341a4968b592ae71ce0933349baabbb2092be762575eac5ab6 Jul 15 15:25:31.463116 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.463078 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bf84888f8-pmgqc"] Jul 15 15:25:31.468038 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:31.468008 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9c7276_1361_4efd_89eb_f3bf081580e3.slice/crio-f6af0f1c3fcd1c07c90fbcabf45553d3947e3cc8796f34a3a39aeba368593399 WatchSource:0}: Error finding container f6af0f1c3fcd1c07c90fbcabf45553d3947e3cc8796f34a3a39aeba368593399: Status 404 returned error can't find the container with id f6af0f1c3fcd1c07c90fbcabf45553d3947e3cc8796f34a3a39aeba368593399 Jul 15 15:25:31.489831 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:31.489034 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv"] Jul 15 15:25:31.497150 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:31.497116 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb01889_fff5_4566_8bf0_f8eed82ce3e9.slice/crio-06f1127e995d2f2d2dfbadc46cac1601c7cb0625ef89e3f6414829691d9a809c WatchSource:0}: Error finding container 06f1127e995d2f2d2dfbadc46cac1601c7cb0625ef89e3f6414829691d9a809c: Status 404 returned error can't find the container with id 06f1127e995d2f2d2dfbadc46cac1601c7cb0625ef89e3f6414829691d9a809c Jul 15 15:25:32.139790 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.139751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" event={"ID":"abb01889-fff5-4566-8bf0-f8eed82ce3e9","Type":"ContainerStarted","Data":"06f1127e995d2f2d2dfbadc46cac1601c7cb0625ef89e3f6414829691d9a809c"} Jul 15 15:25:32.142887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.142031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bf84888f8-pmgqc" event={"ID":"6b9c7276-1361-4efd-89eb-f3bf081580e3","Type":"ContainerStarted","Data":"c87eecc5b1d17165fc43feb1e3a6056686610e8e1297c8b0cc78b351e24a62b9"} Jul 15 15:25:32.142887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.142086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bf84888f8-pmgqc" event={"ID":"6b9c7276-1361-4efd-89eb-f3bf081580e3","Type":"ContainerStarted","Data":"f6af0f1c3fcd1c07c90fbcabf45553d3947e3cc8796f34a3a39aeba368593399"} Jul 15 15:25:32.144871 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.144842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" event={"ID":"72184120-1f18-44ea-8be4-b503a7e1fffd","Type":"ContainerStarted","Data":"4498035c917c1c341a4968b592ae71ce0933349baabbb2092be762575eac5ab6"} Jul 15 15:25:32.170639 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.170576 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bf84888f8-pmgqc" podStartSLOduration=33.170557968 podStartE2EDuration="33.170557968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:32.168826024 +0000 UTC m=+88.565064041" watchObservedRunningTime="2026-07-15 15:25:32.170557968 +0000 UTC m=+88.566795980" Jul 15 15:25:32.300338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.300267 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:32.303755 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:32.303724 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:33.150338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:33.150298 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" event={"ID":"72184120-1f18-44ea-8be4-b503a7e1fffd","Type":"ContainerStarted","Data":"082da85b6f296af5269021871ec8b32b33bd6bd8807bc67d276747e95bbca1cb"} Jul 15 15:25:33.150717 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:33.150670 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:33.152022 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:33.152000 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bf84888f8-pmgqc" Jul 15 15:25:33.169418 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:33.169360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-rtw7x" podStartSLOduration=34.1335203 podStartE2EDuration="35.169337062s" totalImagesPullingTime="1.035816762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:33.16801787 +0000 UTC m=+89.564255892" watchObservedRunningTime="2026-07-15 15:25:33.169337062 +0000 UTC m=+89.565575081" Jul 15 15:25:34.156021 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:34.155926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" event={"ID":"abb01889-fff5-4566-8bf0-f8eed82ce3e9","Type":"ContainerStarted","Data":"e0078827482e04179fb01e23d73485f090200ae0b9cb051a5a4054c8cbd0722a"} Jul 15 15:25:34.174623 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:34.174566 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bp6fv" podStartSLOduration=32.874147389 podStartE2EDuration="35.174549071s" totalImagesPullingTime="2.300401682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:34.173259583 +0000 UTC m=+90.569497602" watchObservedRunningTime="2026-07-15 15:25:34.174549071 +0000 UTC m=+90.570787086" Jul 15 15:25:38.628370 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:38.628328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:38.631173 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:38.631144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47cf9a99-da95-4506-bccf-d64e2918e96a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gn277\" (UID: \"47cf9a99-da95-4506-bccf-d64e2918e96a\") " pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:38.863943 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:38.863904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gn277" Jul 15 15:25:39.011390 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:39.011284 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gn277"] Jul 15 15:25:39.014239 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:39.014206 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cf9a99_da95_4506_bccf_d64e2918e96a.slice/crio-d8ce72944a6c87c4fe3aefeb93c72dd5a5d221386d571b3a10cbe1868d8c9af7 WatchSource:0}: Error finding container d8ce72944a6c87c4fe3aefeb93c72dd5a5d221386d571b3a10cbe1868d8c9af7: Status 404 returned error can't find the container with id d8ce72944a6c87c4fe3aefeb93c72dd5a5d221386d571b3a10cbe1868d8c9af7 Jul 15 15:25:39.179642 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:39.176812 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn277" event={"ID":"47cf9a99-da95-4506-bccf-d64e2918e96a","Type":"ContainerStarted","Data":"d8ce72944a6c87c4fe3aefeb93c72dd5a5d221386d571b3a10cbe1868d8c9af7"} Jul 15 15:25:42.068543 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:42.068513 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mhlcd" Jul 15 15:25:44.885863 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:44.885822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:25:44.888715 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:44.888684 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"image-registry-76d8f4f569-rhfqw\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:25:44.987009 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:44.986975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:25:44.989885 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:44.989852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a995c9-c058-4dd7-9dc4-4a7dd887349d-metrics-tls\") pod \"dns-default-w4tqc\" (UID: \"55a995c9-c058-4dd7-9dc4-4a7dd887349d\") " pod="openshift-dns/dns-default-w4tqc" Jul 15 15:25:45.039114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.039080 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gnc8n"] Jul 15 15:25:45.042106 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.042082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.044646 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.044627 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 15:25:45.044794 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.044629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 15:25:45.045600 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.045460 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 15:25:45.045600 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.045480 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 15:25:45.045600 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.045538 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vstdl\"" Jul 15 15:25:45.087879 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.087729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-tls\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.087879 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.087777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2s48\" (UniqueName: \"kubernetes.io/projected/159cd406-27bf-4a49-8d43-97332c386c5a-kube-api-access-s2s48\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.087879 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.087833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-sys\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.087879 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.087860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-root\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.088399 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.087883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/159cd406-27bf-4a49-8d43-97332c386c5a-metrics-client-ca\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.088399 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.087999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.088399 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.088029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-wtmp\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.088399 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.088068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.088399 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.088099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-textfile\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.146569 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.146488 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdzpm\"" Jul 15 15:25:45.154656 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.154628 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:25:45.158312 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.158292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fj5z9\"" Jul 15 15:25:45.166820 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.166793 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w4tqc" Jul 15 15:25:45.189194 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-textfile\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189357 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-tls\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189357 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2s48\" (UniqueName: \"kubernetes.io/projected/159cd406-27bf-4a49-8d43-97332c386c5a-kube-api-access-s2s48\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189357 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-sys\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189357 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-root\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189357 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/159cd406-27bf-4a49-8d43-97332c386c5a-metrics-client-ca\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-sys\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-wtmp\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-root\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-textfile\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.189667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189592 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-wtmp\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.190011 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:45.189677 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 15:25:45.190011 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:25:45.189750 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-tls podName:159cd406-27bf-4a49-8d43-97332c386c5a nodeName:}" failed. No retries permitted until 2026-07-15 15:25:45.689727814 +0000 UTC m=+102.085965952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-tls") pod "node-exporter-gnc8n" (UID: "159cd406-27bf-4a49-8d43-97332c386c5a") : secret "node-exporter-tls" not found Jul 15 15:25:45.190011 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.189962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/159cd406-27bf-4a49-8d43-97332c386c5a-metrics-client-ca\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.190170 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.190036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.192142 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.192116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.201615 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.201587 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2s48\" (UniqueName: \"kubernetes.io/projected/159cd406-27bf-4a49-8d43-97332c386c5a-kube-api-access-s2s48\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.694037 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.693988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-tls\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.696980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.696952 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/159cd406-27bf-4a49-8d43-97332c386c5a-node-exporter-tls\") pod \"node-exporter-gnc8n\" (UID: \"159cd406-27bf-4a49-8d43-97332c386c5a\") " pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:45.953928 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:45.953897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gnc8n" Jul 15 15:25:47.618565 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:47.618354 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159cd406_27bf_4a49_8d43_97332c386c5a.slice/crio-03cb9ad2e3342ffa1231ddf1a40a216c03694641a2d31853b1319f98c3b9b584 WatchSource:0}: Error finding container 03cb9ad2e3342ffa1231ddf1a40a216c03694641a2d31853b1319f98c3b9b584: Status 404 returned error can't find the container with id 03cb9ad2e3342ffa1231ddf1a40a216c03694641a2d31853b1319f98c3b9b584 Jul 15 15:25:47.785709 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:47.785494 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d8f4f569-rhfqw"] Jul 15 15:25:47.800156 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:47.800106 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e934a77_7ff4_4554_8e57_cf7b679e03c6.slice/crio-f257d8009dbe76bcdc1b9cf599834b880c167076521e96062b40e03854db0ed0 WatchSource:0}: Error finding container f257d8009dbe76bcdc1b9cf599834b880c167076521e96062b40e03854db0ed0: Status 404 returned error can't find the container with id f257d8009dbe76bcdc1b9cf599834b880c167076521e96062b40e03854db0ed0 Jul 15 15:25:47.816240 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:47.816064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w4tqc"] Jul 15 15:25:47.821818 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:47.821780 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a995c9_c058_4dd7_9dc4_4a7dd887349d.slice/crio-9ad7af2c3d383bc571f7ece5aa855afe6778710bc95cd3281e0c401386d7ea6a WatchSource:0}: Error finding container 9ad7af2c3d383bc571f7ece5aa855afe6778710bc95cd3281e0c401386d7ea6a: Status 404 returned error can't find the container with id 9ad7af2c3d383bc571f7ece5aa855afe6778710bc95cd3281e0c401386d7ea6a Jul 15 15:25:48.216365 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.216259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w4tqc" event={"ID":"55a995c9-c058-4dd7-9dc4-4a7dd887349d","Type":"ContainerStarted","Data":"9ad7af2c3d383bc571f7ece5aa855afe6778710bc95cd3281e0c401386d7ea6a"} Jul 15 15:25:48.218746 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.218665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gnc8n" event={"ID":"159cd406-27bf-4a49-8d43-97332c386c5a","Type":"ContainerStarted","Data":"03cb9ad2e3342ffa1231ddf1a40a216c03694641a2d31853b1319f98c3b9b584"} Jul 15 15:25:48.223728 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.222978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-b5r6x" event={"ID":"27216988-e5c2-4e8f-9c08-05cfa7a1c64a","Type":"ContainerStarted","Data":"28f26b60aa3aabcb71ab3dd3ad26f5584db20e0df292c126cf0d5b9d95b2420a"} Jul 15 15:25:48.223728 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.223545 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:48.226280 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.226249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" event={"ID":"5e934a77-7ff4-4554-8e57-cf7b679e03c6","Type":"ContainerStarted","Data":"991ab0a62790760d12f1f835c6827d832ddc8ff2f881d7f00a08e1a71ef56c24"} Jul 15 15:25:48.226418 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.226301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" event={"ID":"5e934a77-7ff4-4554-8e57-cf7b679e03c6","Type":"ContainerStarted","Data":"f257d8009dbe76bcdc1b9cf599834b880c167076521e96062b40e03854db0ed0"} Jul 15 15:25:48.227676 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.227621 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:25:48.233785 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.233398 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-b5r6x" Jul 15 15:25:48.251873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.251689 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-b5r6x" podStartSLOduration=2.051857035 podStartE2EDuration="20.251667434s" totalImagesPullingTime="18.199810399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:48.249855248 +0000 UTC m=+104.646093269" watchObservedRunningTime="2026-07-15 15:25:48.251667434 +0000 UTC m=+104.647905451" Jul 15 15:25:48.305493 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:48.304330 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" podStartSLOduration=103.304301134 podStartE2EDuration="1m43.304301134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:48.282672839 +0000 UTC m=+104.678910857" watchObservedRunningTime="2026-07-15 15:25:48.304301134 +0000 UTC m=+104.700539142" Jul 15 15:25:50.238836 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:50.238751 2578 generic.go:356] "Generic (PLEG): container finished" podID="159cd406-27bf-4a49-8d43-97332c386c5a" containerID="689db4f520afe52240b6b2babc020a29c1617d082aa9b0991b292855c58bc34a" exitCode=0 Jul 15 15:25:50.239967 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:50.239939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gnc8n" event={"ID":"159cd406-27bf-4a49-8d43-97332c386c5a","Type":"ContainerDied","Data":"689db4f520afe52240b6b2babc020a29c1617d082aa9b0991b292855c58bc34a"} Jul 15 15:25:51.334673 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.334632 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:25:51.385821 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.385772 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:25:51.386183 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.386159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.389113 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.389091 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 15:25:51.389639 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.389509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 15:25:51.389639 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.389524 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8qjdo7bb4s4v4\"" Jul 15 15:25:51.389639 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.389536 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 15:25:51.389933 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.389914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 15:25:51.390008 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.389963 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 15:25:51.390068 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390049 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 15:25:51.390068 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390062 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 15:25:51.390322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390142 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 15:25:51.390322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 15:25:51.390322 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390309 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 15:25:51.390502 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390423 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 15:25:51.390502 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390431 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 15:25:51.390716 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.390694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 15:25:51.392351 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.391068 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 15:25:51.392351 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.391155 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pvl22\"" Jul 15 15:25:51.394403 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.393874 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 15:25:51.454840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.454801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.454840 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.454844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455136 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.454868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455136 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.454896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455136 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.454926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455301 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455301 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455301 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455301 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455301 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455301 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455632 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455632 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455632 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455632 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2697l\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-kube-api-access-2697l\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455829 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455829 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455829 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455974 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.455974 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.455873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556355 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556580 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2697l\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-kube-api-access-2697l\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.556930 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.557422 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.557422 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.556967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.560508 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.558132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.560508 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.558631 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.560508 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.560289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.561060 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.561033 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.561674 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.561325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.561674 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.561661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.564616 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.562960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.564616 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.563590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.564845 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.564591 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.564845 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.564598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.567227 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.565031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.567227 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.566906 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.567227 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.566932 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.567385 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.567224 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.567771 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.567750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.568178 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.568123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.569536 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.568801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.569536 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.569267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.570758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.570734 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.571747 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.571722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2697l\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-kube-api-access-2697l\") pod \"prometheus-k8s-0\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:51.699821 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:51.699764 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:25:52.082527 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:52.082420 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76d8f4f569-rhfqw"] Jul 15 15:25:55.192037 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:55.192003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:25:55.263312 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:55.263239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w4tqc" event={"ID":"55a995c9-c058-4dd7-9dc4-4a7dd887349d","Type":"ContainerStarted","Data":"064803f3f1dcd6dc541763e59ffd5a8c70545fbbd689a001a8b8ed8cd637c618"} Jul 15 15:25:55.265494 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:55.265450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gnc8n" event={"ID":"159cd406-27bf-4a49-8d43-97332c386c5a","Type":"ContainerStarted","Data":"ad7df832870ac7a534cf48956538faba599e461499f4a574b1d8cdbdfa99bd76"} Jul 15 15:25:55.361657 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:25:55.361618 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854aec7a_11a1_49ff_bb6f_2c14c77049fe.slice/crio-bf49ded2c5e014631811483544ff5489b399ed354bcf67e1490043368eb46a27 WatchSource:0}: Error finding container bf49ded2c5e014631811483544ff5489b399ed354bcf67e1490043368eb46a27: Status 404 returned error can't find the container with id bf49ded2c5e014631811483544ff5489b399ed354bcf67e1490043368eb46a27 Jul 15 15:25:56.280074 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.279073 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w4tqc" event={"ID":"55a995c9-c058-4dd7-9dc4-4a7dd887349d","Type":"ContainerStarted","Data":"8bdd773093c36bbaa7bdd0c98445cccf0206cea8f152d9c7dc633b679daf54f0"} Jul 15 15:25:56.280074 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.279993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w4tqc" Jul 15 15:25:56.285659 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.285585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gnc8n" event={"ID":"159cd406-27bf-4a49-8d43-97332c386c5a","Type":"ContainerStarted","Data":"68a2c1dcb2c89dd6250e6618cceb5e43a7b640b38ffc4021fc086c598d128deb"} Jul 15 15:25:56.288435 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.288321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn277" event={"ID":"47cf9a99-da95-4506-bccf-d64e2918e96a","Type":"ContainerStarted","Data":"45f39073dbc1e1ee48485775a37b12505845b836fe466419593bababfc097784"} Jul 15 15:25:56.291743 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.291714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"bf49ded2c5e014631811483544ff5489b399ed354bcf67e1490043368eb46a27"} Jul 15 15:25:56.299853 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.299800 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w4tqc" podStartSLOduration=69.114410744 podStartE2EDuration="1m16.299781582s" totalImagesPullingTime="7.185370838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:56.299142999 +0000 UTC m=+112.695381030" watchObservedRunningTime="2026-07-15 15:25:56.299781582 +0000 UTC m=+112.696019592" Jul 15 15:25:56.323760 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:25:56.322062 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gnc8n" podStartSLOduration=9.14626969 podStartE2EDuration="11.322038604s" totalImagesPullingTime="2.062077713s" totalInitContainerRuntime="113.691201ms" isStatefulPod=true podCreationTimestamp="2026-07-15 15:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:25:56.319897578 +0000 UTC m=+112.716135594" watchObservedRunningTime="2026-07-15 15:25:56.322038604 +0000 UTC m=+112.718276621" Jul 15 15:26:00.309914 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:00.309876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn277" event={"ID":"47cf9a99-da95-4506-bccf-d64e2918e96a","Type":"ContainerStarted","Data":"cd5b30c5c57c2d68a65db37a6415c607c17fa596623ece0ac1ceddb800d0b25f"} Jul 15 15:26:00.311299 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:00.311273 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75" exitCode=0 Jul 15 15:26:00.311420 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:00.311354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75"} Jul 15 15:26:02.090024 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:02.089991 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:26:06.342001 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:06.341961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gn277" event={"ID":"47cf9a99-da95-4506-bccf-d64e2918e96a","Type":"ContainerStarted","Data":"999bd65b77d3c6b314b46eb0bb64c2c90b227cf72e4831c0b6cb919401dfcf86"} Jul 15 15:26:06.344298 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:06.344266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672"} Jul 15 15:26:06.344428 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:06.344351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771"} Jul 15 15:26:06.363207 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:06.363148 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gn277" podStartSLOduration=33.972858132 podStartE2EDuration="1m0.363080845s" totalImagesPullingTime="26.390222713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:25:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:26:06.362016951 +0000 UTC m=+122.758254977" watchObservedRunningTime="2026-07-15 15:26:06.363080845 +0000 UTC m=+122.759318862" Jul 15 15:26:07.302926 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:07.302888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w4tqc" Jul 15 15:26:11.367039 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:11.367003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311"} Jul 15 15:26:11.367430 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:11.367071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9"} Jul 15 15:26:11.367430 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:11.367113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78"} Jul 15 15:26:11.367430 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:11.367141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerStarted","Data":"d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897"} Jul 15 15:26:11.396478 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:11.396420 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.841766576 podStartE2EDuration="20.396402441s" totalImagesPullingTime="14.536071106s" totalInitContainerRuntime="18.564759ms" isStatefulPod=false podCreationTimestamp="2026-07-15 15:25:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:26:11.39511581 +0000 UTC m=+127.791353827" watchObservedRunningTime="2026-07-15 15:26:11.396402441 +0000 UTC m=+127.792640534" Jul 15 15:26:11.700145 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:11.700117 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:26:14.073815 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:14.073776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:26:14.076163 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:14.076125 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1e695ec-b4be-4a8b-b47e-8eed3ba65faf-metrics-certs\") pod \"network-metrics-daemon-z75wl\" (UID: \"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf\") " pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:26:14.188338 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:14.188300 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qs6fl\"" Jul 15 15:26:14.195566 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:14.195535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z75wl" Jul 15 15:26:14.361533 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:14.361367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z75wl"] Jul 15 15:26:14.364048 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:26:14.364021 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e695ec_b4be_4a8b_b47e_8eed3ba65faf.slice/crio-3eca4747a1d801d4364b94a79bbd2a0dd93383cc5438010184984c89801e9b6a WatchSource:0}: Error finding container 3eca4747a1d801d4364b94a79bbd2a0dd93383cc5438010184984c89801e9b6a: Status 404 returned error can't find the container with id 3eca4747a1d801d4364b94a79bbd2a0dd93383cc5438010184984c89801e9b6a Jul 15 15:26:14.379320 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:14.379294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z75wl" event={"ID":"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf","Type":"ContainerStarted","Data":"3eca4747a1d801d4364b94a79bbd2a0dd93383cc5438010184984c89801e9b6a"} Jul 15 15:26:16.389505 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:16.389402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z75wl" event={"ID":"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf","Type":"ContainerStarted","Data":"dc19a68118a9d2120e69f46de12f53253d6a75d190891e503ce6ab6952d5be00"} Jul 15 15:26:16.389505 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:16.389488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z75wl" event={"ID":"f1e695ec-b4be-4a8b-b47e-8eed3ba65faf","Type":"ContainerStarted","Data":"424ac9bef96ac4b61a87a8091b73fdd0e7415e1f27f15fe8ae6ddfdeacfbedc9"} Jul 15 15:26:16.406809 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:16.406752 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z75wl" podStartSLOduration=129.959745635 podStartE2EDuration="2m11.406737248s" totalImagesPullingTime="1.446991613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:26:16.405568907 +0000 UTC m=+132.801806923" watchObservedRunningTime="2026-07-15 15:26:16.406737248 +0000 UTC m=+132.802975263" Jul 15 15:26:17.111181 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.111139 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" podUID="5e934a77-7ff4-4554-8e57-cf7b679e03c6" containerName="registry" containerID="cri-o://991ab0a62790760d12f1f835c6827d832ddc8ff2f881d7f00a08e1a71ef56c24" gracePeriod=30 Jul 15 15:26:17.395153 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.395120 2578 generic.go:356] "Generic (PLEG): container finished" podID="5e934a77-7ff4-4554-8e57-cf7b679e03c6" containerID="991ab0a62790760d12f1f835c6827d832ddc8ff2f881d7f00a08e1a71ef56c24" exitCode=0 Jul 15 15:26:17.395545 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.395194 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" event={"ID":"5e934a77-7ff4-4554-8e57-cf7b679e03c6","Type":"ContainerDied","Data":"991ab0a62790760d12f1f835c6827d832ddc8ff2f881d7f00a08e1a71ef56c24"} Jul 15 15:26:17.395545 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.395256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" event={"ID":"5e934a77-7ff4-4554-8e57-cf7b679e03c6","Type":"ContainerDied","Data":"f257d8009dbe76bcdc1b9cf599834b880c167076521e96062b40e03854db0ed0"} Jul 15 15:26:17.395545 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.395279 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f257d8009dbe76bcdc1b9cf599834b880c167076521e96062b40e03854db0ed0" Jul 15 15:26:17.401003 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.400981 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:26:17.598007 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.597974 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psvtv\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-kube-api-access-psvtv\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598017 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e934a77-7ff4-4554-8e57-cf7b679e03c6-ca-trust-extracted\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598036 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-certificates\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598057 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-image-registry-private-configuration\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598077 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-installation-pull-secrets\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598104 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-trusted-ca\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598219 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598197 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-bound-sa-token\") pod \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\" (UID: \"5e934a77-7ff4-4554-8e57-cf7b679e03c6\") " Jul 15 15:26:17.598641 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598599 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:26:17.598982 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.598884 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:26:17.601272 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.601219 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:26:17.601272 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.601244 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-kube-api-access-psvtv" (OuterVolumeSpecName: "kube-api-access-psvtv") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "kube-api-access-psvtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:26:17.601441 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.601289 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:26:17.601441 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.601396 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:26:17.601577 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.601478 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:26:17.607621 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.607597 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e934a77-7ff4-4554-8e57-cf7b679e03c6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5e934a77-7ff4-4554-8e57-cf7b679e03c6" (UID: "5e934a77-7ff4-4554-8e57-cf7b679e03c6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698752 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-bound-sa-token\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698787 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psvtv\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-kube-api-access-psvtv\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698797 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e934a77-7ff4-4554-8e57-cf7b679e03c6-ca-trust-extracted\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698806 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-certificates\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698816 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-image-registry-private-configuration\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698824 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e934a77-7ff4-4554-8e57-cf7b679e03c6-installation-pull-secrets\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698832 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e934a77-7ff4-4554-8e57-cf7b679e03c6-trusted-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:17.698833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:17.698840 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e934a77-7ff4-4554-8e57-cf7b679e03c6-registry-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:26:18.399544 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:18.399512 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d8f4f569-rhfqw" Jul 15 15:26:18.428618 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:18.428582 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76d8f4f569-rhfqw"] Jul 15 15:26:18.433897 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:18.433869 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76d8f4f569-rhfqw"] Jul 15 15:26:19.776512 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:19.776459 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e934a77-7ff4-4554-8e57-cf7b679e03c6" path="/var/lib/kubelet/pods/5e934a77-7ff4-4554-8e57-cf7b679e03c6/volumes" Jul 15 15:26:20.409764 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:20.409684 2578 generic.go:356] "Generic (PLEG): container finished" podID="166bfde5-78e1-4753-8d35-4a945452b5ef" containerID="b11b9c13affc5de657d51ed47103a228e6ef073f5b6dbd52dd625c737b9eaf36" exitCode=0 Jul 15 15:26:20.410093 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:20.409761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" event={"ID":"166bfde5-78e1-4753-8d35-4a945452b5ef","Type":"ContainerDied","Data":"b11b9c13affc5de657d51ed47103a228e6ef073f5b6dbd52dd625c737b9eaf36"} Jul 15 15:26:20.410234 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:20.410211 2578 scope.go:117] "RemoveContainer" containerID="b11b9c13affc5de657d51ed47103a228e6ef073f5b6dbd52dd625c737b9eaf36" Jul 15 15:26:20.411379 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:20.411356 2578 generic.go:356] "Generic (PLEG): container finished" podID="7a7634a8-6d9c-4524-8cd3-4bea0679614d" containerID="dde54015457424b763fd393227fab0ecd1aed60650b32be3631ddb419812d076" exitCode=0 Jul 15 15:26:20.411487 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:20.411401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" event={"ID":"7a7634a8-6d9c-4524-8cd3-4bea0679614d","Type":"ContainerDied","Data":"dde54015457424b763fd393227fab0ecd1aed60650b32be3631ddb419812d076"} Jul 15 15:26:20.411707 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:20.411695 2578 scope.go:117] "RemoveContainer" containerID="dde54015457424b763fd393227fab0ecd1aed60650b32be3631ddb419812d076" Jul 15 15:26:21.417152 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:21.417115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fqrlc" event={"ID":"7a7634a8-6d9c-4524-8cd3-4bea0679614d","Type":"ContainerStarted","Data":"e1012b4d27c0ce7e497cca0dc0310ccb96223707cf0c19e85af9a5e6752d64c2"} Jul 15 15:26:21.418879 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:21.418852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7pscr" event={"ID":"166bfde5-78e1-4753-8d35-4a945452b5ef","Type":"ContainerStarted","Data":"cb42885c90cd820de580dae213ccb5fee9b3b75fd7b7a933dd0d3bf1c00e5b00"} Jul 15 15:26:36.482197 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:36.482160 2578 generic.go:356] "Generic (PLEG): container finished" podID="db0a5b5a-26a3-4d18-a2f2-54e6954eec56" containerID="c6afcf9b73f2a20ef50347e256b27b34b9d8fcb1ca14aa614b8821179d925524" exitCode=0 Jul 15 15:26:36.482618 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:36.482211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" event={"ID":"db0a5b5a-26a3-4d18-a2f2-54e6954eec56","Type":"ContainerDied","Data":"c6afcf9b73f2a20ef50347e256b27b34b9d8fcb1ca14aa614b8821179d925524"} Jul 15 15:26:36.482618 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:36.482591 2578 scope.go:117] "RemoveContainer" containerID="c6afcf9b73f2a20ef50347e256b27b34b9d8fcb1ca14aa614b8821179d925524" Jul 15 15:26:37.487204 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:37.487168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6mxld" event={"ID":"db0a5b5a-26a3-4d18-a2f2-54e6954eec56","Type":"ContainerStarted","Data":"af3b6f4dac3b4596fe72aadd2e136ed8dd8008eab35ee6f1a02a00eafab9c294"} Jul 15 15:26:51.700725 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:51.700679 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:26:51.716816 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:51.716790 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:26:52.568835 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:26:52.568797 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:10.273412 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273323 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:27:10.273873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273638 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="prometheus" containerID="cri-o://e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771" gracePeriod=600 Jul 15 15:27:10.273873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273691 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311" gracePeriod=600 Jul 15 15:27:10.273873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273744 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-web" containerID="cri-o://99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78" gracePeriod=600 Jul 15 15:27:10.273873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273692 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="thanos-sidecar" containerID="cri-o://d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897" gracePeriod=600 Jul 15 15:27:10.273873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273671 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy" containerID="cri-o://6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9" gracePeriod=600 Jul 15 15:27:10.273873 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.273699 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="config-reloader" containerID="cri-o://a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672" gracePeriod=600 Jul 15 15:27:10.622631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622551 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311" exitCode=0 Jul 15 15:27:10.622631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622576 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9" exitCode=0 Jul 15 15:27:10.622631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622583 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897" exitCode=0 Jul 15 15:27:10.622631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622590 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672" exitCode=0 Jul 15 15:27:10.622631 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622596 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771" exitCode=0 Jul 15 15:27:10.622887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311"} Jul 15 15:27:10.622887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622694 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9"} Jul 15 15:27:10.622887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622720 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897"} Jul 15 15:27:10.622887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672"} Jul 15 15:27:10.622887 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:10.622773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771"} Jul 15 15:27:11.522767 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.522740 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.602361 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602283 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-serving-certs-ca-bundle\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602361 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602326 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-tls\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602361 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602353 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602393 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602409 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-0\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602434 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-metrics-client-certs\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602484 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-web-config\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602525 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-2\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602554 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-thanos-prometheus-http-client-file\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602581 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-kubelet-serving-ca-bundle\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.602991 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602892 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.602991 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602954 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.602991 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.602959 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config-out\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603150 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603021 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603150 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603049 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-grpc-tls\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603150 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603081 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-kube-rbac-proxy\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603150 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603133 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-trusted-ca-bundle\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603334 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603159 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2697l\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-kube-api-access-2697l\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603334 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603185 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-metrics-client-ca\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603334 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603219 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-db\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603334 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603243 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-tls-assets\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603334 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603272 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-1\") pod \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\" (UID: \"854aec7a-11a1-49ff-bb6f-2c14c77049fe\") " Jul 15 15:27:11.603667 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603648 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.603833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603818 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.603939 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.603756 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.604388 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.604358 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.605292 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.605260 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.605394 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.605298 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.605586 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.605555 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 15:27:11.606586 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.606562 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:27:11.606691 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.606617 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.607348 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.607310 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.607448 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.607400 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.607557 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.607533 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-kube-api-access-2697l" (OuterVolumeSpecName: "kube-api-access-2697l") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "kube-api-access-2697l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:27:11.607715 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.607694 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config-out" (OuterVolumeSpecName: "config-out") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 15:27:11.608033 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.608009 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.608416 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.608391 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.608521 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.608491 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config" (OuterVolumeSpecName: "config") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.608725 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.608693 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.608891 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.608876 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.609455 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.609423 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 15:27:11.618988 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.618962 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-web-config" (OuterVolumeSpecName: "web-config") pod "854aec7a-11a1-49ff-bb6f-2c14c77049fe" (UID: "854aec7a-11a1-49ff-bb6f-2c14c77049fe"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 15:27:11.629899 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.629873 2578 generic.go:356] "Generic (PLEG): container finished" podID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerID="99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78" exitCode=0 Jul 15 15:27:11.630002 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.629942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78"} Jul 15 15:27:11.630057 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.630005 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.630057 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.630029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"854aec7a-11a1-49ff-bb6f-2c14c77049fe","Type":"ContainerDied","Data":"bf49ded2c5e014631811483544ff5489b399ed354bcf67e1490043368eb46a27"} Jul 15 15:27:11.630139 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.630067 2578 scope.go:117] "RemoveContainer" containerID="d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311" Jul 15 15:27:11.638047 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.638026 2578 scope.go:117] "RemoveContainer" containerID="6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9" Jul 15 15:27:11.645507 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.645489 2578 scope.go:117] "RemoveContainer" containerID="99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78" Jul 15 15:27:11.653535 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.653516 2578 scope.go:117] "RemoveContainer" containerID="d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897" Jul 15 15:27:11.661038 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.661020 2578 scope.go:117] "RemoveContainer" containerID="a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672" Jul 15 15:27:11.667905 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.667879 2578 scope.go:117] "RemoveContainer" containerID="e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771" Jul 15 15:27:11.675706 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.675687 2578 scope.go:117] "RemoveContainer" containerID="66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75" Jul 15 15:27:11.681417 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.681390 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:27:11.682516 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.682498 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:27:11.683241 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.683227 2578 scope.go:117] "RemoveContainer" containerID="d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311" Jul 15 15:27:11.683558 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.683539 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311\": container with ID starting with d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311 not found: ID does not exist" containerID="d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311" Jul 15 15:27:11.683599 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.683569 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311"} err="failed to get container status \"d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311\": rpc error: code = NotFound desc = could not find container \"d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311\": container with ID starting with d24aa05ef53a51a4b5dea7015c09fb7205f14727cc900135dae513cb30f53311 not found: ID does not exist" Jul 15 15:27:11.683649 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.683604 2578 scope.go:117] "RemoveContainer" containerID="6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9" Jul 15 15:27:11.683860 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.683842 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9\": container with ID starting with 6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9 not found: ID does not exist" containerID="6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9" Jul 15 15:27:11.683909 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.683867 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9"} err="failed to get container status \"6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9\": rpc error: code = NotFound desc = could not find container \"6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9\": container with ID starting with 6f141121d1cf8099004e7a5a83a01acb9cb3c8b071feee33eadbd072b0bfcde9 not found: ID does not exist" Jul 15 15:27:11.683909 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.683885 2578 scope.go:117] "RemoveContainer" containerID="99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78" Jul 15 15:27:11.684143 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.684125 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78\": container with ID starting with 99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78 not found: ID does not exist" containerID="99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78" Jul 15 15:27:11.684182 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684147 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78"} err="failed to get container status \"99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78\": rpc error: code = NotFound desc = could not find container \"99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78\": container with ID starting with 99ebcec23e32e7a7636db4a091df0485e12f1eba36a592a7b4ac166b17380a78 not found: ID does not exist" Jul 15 15:27:11.684182 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684162 2578 scope.go:117] "RemoveContainer" containerID="d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897" Jul 15 15:27:11.684384 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.684367 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897\": container with ID starting with d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897 not found: ID does not exist" containerID="d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897" Jul 15 15:27:11.684421 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684389 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897"} err="failed to get container status \"d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897\": rpc error: code = NotFound desc = could not find container \"d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897\": container with ID starting with d0be4d39956b501ac9ec1dd803c796b85cb1af5a125e22e27ad7a0b14ab32897 not found: ID does not exist" Jul 15 15:27:11.684421 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684402 2578 scope.go:117] "RemoveContainer" containerID="a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672" Jul 15 15:27:11.684684 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.684668 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672\": container with ID starting with a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672 not found: ID does not exist" containerID="a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672" Jul 15 15:27:11.684742 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684686 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672"} err="failed to get container status \"a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672\": rpc error: code = NotFound desc = could not find container \"a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672\": container with ID starting with a228e8896f423321df5f8af56896c0b937fdba668f63f1c997a5b715bcc23672 not found: ID does not exist" Jul 15 15:27:11.684742 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684700 2578 scope.go:117] "RemoveContainer" containerID="e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771" Jul 15 15:27:11.684923 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.684907 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771\": container with ID starting with e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771 not found: ID does not exist" containerID="e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771" Jul 15 15:27:11.684962 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684925 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771"} err="failed to get container status \"e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771\": rpc error: code = NotFound desc = could not find container \"e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771\": container with ID starting with e41688247ebfd56c84fb96d2303b42a6fa7b9fae84823958d499da7bf9684771 not found: ID does not exist" Jul 15 15:27:11.684962 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.684937 2578 scope.go:117] "RemoveContainer" containerID="66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75" Jul 15 15:27:11.685147 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:27:11.685129 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75\": container with ID starting with 66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75 not found: ID does not exist" containerID="66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75" Jul 15 15:27:11.685184 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.685154 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75"} err="failed to get container status \"66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75\": rpc error: code = NotFound desc = could not find container \"66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75\": container with ID starting with 66464a340d0fafdfc08e52e161327d6e81581332cf3fef3b6ded18025b20bb75 not found: ID does not exist" Jul 15 15:27:11.704602 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704573 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704602 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704603 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704614 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704623 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704632 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-metrics-client-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704640 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-web-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704649 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704657 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config-out\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704665 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704672 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-grpc-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704680 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/854aec7a-11a1-49ff-bb6f-2c14c77049fe-secret-kube-rbac-proxy\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704688 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704696 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2697l\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-kube-api-access-2697l\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704703 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-metrics-client-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704712 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-db\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704721 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/854aec7a-11a1-49ff-bb6f-2c14c77049fe-tls-assets\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704729 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.704758 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.704738 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/854aec7a-11a1-49ff-bb6f-2c14c77049fe-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 15:27:11.769253 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769218 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:27:11.769523 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769510 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e934a77-7ff4-4554-8e57-cf7b679e03c6" containerName="registry" Jul 15 15:27:11.769570 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769525 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e934a77-7ff4-4554-8e57-cf7b679e03c6" containerName="registry" Jul 15 15:27:11.769570 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769540 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-thanos" Jul 15 15:27:11.769570 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769546 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-thanos" Jul 15 15:27:11.769570 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769556 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="prometheus" Jul 15 15:27:11.769570 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769561 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="prometheus" Jul 15 15:27:11.769570 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769568 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="config-reloader" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769575 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="config-reloader" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769585 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="thanos-sidecar" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769593 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="thanos-sidecar" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769598 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769604 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769613 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="init-config-reloader" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769618 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="init-config-reloader" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769625 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-web" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769630 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-web" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769684 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="config-reloader" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769692 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-web" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769701 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769706 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="prometheus" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769712 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="kube-rbac-proxy-thanos" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769717 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e934a77-7ff4-4554-8e57-cf7b679e03c6" containerName="registry" Jul 15 15:27:11.769749 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.769722 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" containerName="thanos-sidecar" Jul 15 15:27:11.773389 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.773364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.778250 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.778216 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="854aec7a-11a1-49ff-bb6f-2c14c77049fe" path="/var/lib/kubelet/pods/854aec7a-11a1-49ff-bb6f-2c14c77049fe/volumes" Jul 15 15:27:11.787552 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.787528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 15:27:11.787669 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.787537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 15:27:11.787844 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.787827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 15:27:11.788072 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.788051 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 15:27:11.788158 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.788054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 15:27:11.788158 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.788059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 15:27:11.788826 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.788812 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 15:27:11.789989 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.789970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 15:27:11.790059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.789980 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pvl22\"" Jul 15 15:27:11.790059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.790011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 15:27:11.790186 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.790034 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 15:27:11.790244 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.790230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 15:27:11.790452 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.790435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 15:27:11.790541 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.790435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8qjdo7bb4s4v4\"" Jul 15 15:27:11.791269 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.791254 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 15:27:11.791826 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.791812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 15:27:11.811258 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.811231 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 15:27:11.826124 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.826090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:27:11.906257 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906257 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906257 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906257 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-config\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-web-config\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.906609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.907005 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.907005 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.907005 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-config-out\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.907005 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.907005 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5p8q\" (UniqueName: \"kubernetes.io/projected/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-kube-api-access-h5p8q\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:11.907005 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:11.906812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007772 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007772 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-web-config\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.007987 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.007969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-config-out\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5p8q\" (UniqueName: \"kubernetes.io/projected/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-kube-api-access-h5p8q\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-config\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008328 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.008867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.008705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.009142 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.009121 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.009277 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.009241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.010569 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.010539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.011206 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.011178 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.011875 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.011730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.012078 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.012036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.012078 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.012042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.012500 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.012450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.012589 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.012522 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.012811 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.012791 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-web-config\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.013370 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.013349 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.013442 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.013382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-config-out\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.013548 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.013531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.013627 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.013613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-config\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.014380 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.014364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.025565 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.025532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5p8q\" (UniqueName: \"kubernetes.io/projected/0743c9dd-3b9e-43bc-9b70-f517a7ebc143-kube-api-access-h5p8q\") pod \"prometheus-k8s-0\" (UID: \"0743c9dd-3b9e-43bc-9b70-f517a7ebc143\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.083362 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.083319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:27:12.249199 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.249166 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 15:27:12.252339 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:27:12.252312 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0743c9dd_3b9e_43bc_9b70_f517a7ebc143.slice/crio-8100d10640069a552dc6eab0ea3974d24b39404b58d9560201f65cda486995e6 WatchSource:0}: Error finding container 8100d10640069a552dc6eab0ea3974d24b39404b58d9560201f65cda486995e6: Status 404 returned error can't find the container with id 8100d10640069a552dc6eab0ea3974d24b39404b58d9560201f65cda486995e6 Jul 15 15:27:12.634736 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.634695 2578 generic.go:356] "Generic (PLEG): container finished" podID="0743c9dd-3b9e-43bc-9b70-f517a7ebc143" containerID="7cf2c67d8c93d4c819bc7d72743361a3a06b58f5a74b54e1600b00a10768fac9" exitCode=0 Jul 15 15:27:12.635209 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.634786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerDied","Data":"7cf2c67d8c93d4c819bc7d72743361a3a06b58f5a74b54e1600b00a10768fac9"} Jul 15 15:27:12.635209 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:12.634851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"8100d10640069a552dc6eab0ea3974d24b39404b58d9560201f65cda486995e6"} Jul 15 15:27:13.643640 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:13.643605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"a9786ec73caecc47f3092462b0e3dfbbd949b9fbf066e12ad23453cb0e6d4efc"} Jul 15 15:27:13.644035 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:13.643700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"5ea7ccf9a838756d0091f1502aa5e87b797e68e65fce8d905eb40c114e0e89b5"} Jul 15 15:27:13.644035 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:13.643728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"926c811215db5f27c97b3dd245f2413d4352dd2085ca7d5b6199a45777b13511"} Jul 15 15:27:13.644035 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:13.643756 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"beb4914cf08dc42bfee9181f054b73f2c04cec4ecc57df175d1342cf3c0ab705"} Jul 15 15:27:13.644035 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:13.643779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"2c4ca608055f0ccf314a8a3996d990f53c1c08ae4f1f5441f67d5585c171c849"} Jul 15 15:27:13.644035 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:13.643802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0743c9dd-3b9e-43bc-9b70-f517a7ebc143","Type":"ContainerStarted","Data":"b638d2d8a8b6dd49a013ceba22f0c0ee3daa409d5435838b5b2a68a4c78eb2ca"} Jul 15 15:27:17.083624 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:27:17.083572 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:28:12.083689 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:28:12.083634 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:28:12.099561 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:28:12.099534 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:28:12.141041 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:28:12.140971 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=61.12304158 podStartE2EDuration="1m1.140945726s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.904146ms" isStatefulPod=false podCreationTimestamp="2026-07-15 15:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:27:13.710301838 +0000 UTC m=+190.106539854" watchObservedRunningTime="2026-07-15 15:28:12.140945726 +0000 UTC m=+248.537183745" Jul 15 15:28:12.887867 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:28:12.887840 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 15:29:04.027871 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:29:04.027842 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:29:04.033165 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:29:04.033144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:29:04.033165 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:29:04.033152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:29:04.039531 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:29:04.039506 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 15:29:04.039531 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:29:04.039512 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:30:39.104958 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.104926 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v"] Jul 15 15:30:39.108304 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.108287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.110905 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.110882 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 15:30:39.111033 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.110949 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 15:30:39.111033 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.110949 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 15:30:39.111033 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.110953 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r5ptn\"" Jul 15 15:30:39.111362 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.111345 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 15:30:39.140784 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.140752 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v"] Jul 15 15:30:39.210358 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.210319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6691a46-fe9d-4732-91a1-b3a0d101b310-tmp\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.210358 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.210357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6691a46-fe9d-4732-91a1-b3a0d101b310-webhook-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.210645 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.210376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6691a46-fe9d-4732-91a1-b3a0d101b310-manifests\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.210645 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.210514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6691a46-fe9d-4732-91a1-b3a0d101b310-apiservice-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.210645 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.210578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv99v\" (UniqueName: \"kubernetes.io/projected/d6691a46-fe9d-4732-91a1-b3a0d101b310-kube-api-access-sv99v\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.311575 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.311535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv99v\" (UniqueName: \"kubernetes.io/projected/d6691a46-fe9d-4732-91a1-b3a0d101b310-kube-api-access-sv99v\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.311777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.311631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6691a46-fe9d-4732-91a1-b3a0d101b310-tmp\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.311777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.311655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6691a46-fe9d-4732-91a1-b3a0d101b310-webhook-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.311777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.311679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6691a46-fe9d-4732-91a1-b3a0d101b310-manifests\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.311777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.311719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6691a46-fe9d-4732-91a1-b3a0d101b310-apiservice-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.312145 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.312121 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6691a46-fe9d-4732-91a1-b3a0d101b310-manifests\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.313965 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.313936 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6691a46-fe9d-4732-91a1-b3a0d101b310-tmp\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.314249 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.314231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6691a46-fe9d-4732-91a1-b3a0d101b310-apiservice-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.314321 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.314253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6691a46-fe9d-4732-91a1-b3a0d101b310-webhook-cert\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.321000 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.320972 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv99v\" (UniqueName: \"kubernetes.io/projected/d6691a46-fe9d-4732-91a1-b3a0d101b310-kube-api-access-sv99v\") pod \"opendatahub-operator-controller-manager-997df6bcb-7qt2v\" (UID: \"d6691a46-fe9d-4732-91a1-b3a0d101b310\") " pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.418307 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.418228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:39.561152 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.561119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v"] Jul 15 15:30:39.564838 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:30:39.564810 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6691a46_fe9d_4732_91a1_b3a0d101b310.slice/crio-ca6ca322577e464ceca4c7510c1277a1ed8e04b17c830533c55fbd7a9267a57c WatchSource:0}: Error finding container ca6ca322577e464ceca4c7510c1277a1ed8e04b17c830533c55fbd7a9267a57c: Status 404 returned error can't find the container with id ca6ca322577e464ceca4c7510c1277a1ed8e04b17c830533c55fbd7a9267a57c Jul 15 15:30:39.566803 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:39.566784 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 15:30:40.443275 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:40.443235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" event={"ID":"d6691a46-fe9d-4732-91a1-b3a0d101b310","Type":"ContainerStarted","Data":"ca6ca322577e464ceca4c7510c1277a1ed8e04b17c830533c55fbd7a9267a57c"} Jul 15 15:30:43.463980 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:43.463938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" event={"ID":"d6691a46-fe9d-4732-91a1-b3a0d101b310","Type":"ContainerStarted","Data":"b9727e2fabf3e41dca008fa10b9cd6f9e02a13d8d17e9e1ceb51a6f30b18375f"} Jul 15 15:30:44.469445 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:44.469413 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6691a46-fe9d-4732-91a1-b3a0d101b310" containerID="b9727e2fabf3e41dca008fa10b9cd6f9e02a13d8d17e9e1ceb51a6f30b18375f" exitCode=0 Jul 15 15:30:44.469941 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:44.469488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" event={"ID":"d6691a46-fe9d-4732-91a1-b3a0d101b310","Type":"ContainerDied","Data":"b9727e2fabf3e41dca008fa10b9cd6f9e02a13d8d17e9e1ceb51a6f30b18375f"} Jul 15 15:30:46.479765 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:46.479728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" event={"ID":"d6691a46-fe9d-4732-91a1-b3a0d101b310","Type":"ContainerStarted","Data":"cec02b40e76c7fc7cc4cc0388c0ce2e2aa3204ea8efd361614de0e37ac2774bd"} Jul 15 15:30:46.480224 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:46.479840 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:30:46.514053 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:46.513999 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" podStartSLOduration=1.926341403 podStartE2EDuration="7.513978365s" totalImagesPullingTime="4.468650718s" totalInitContainerRuntime="1.118986244s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:30:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:30:46.511843284 +0000 UTC m=+402.908081300" watchObservedRunningTime="2026-07-15 15:30:46.513978365 +0000 UTC m=+402.910216383" Jul 15 15:30:57.486923 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:30:57.486888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-997df6bcb-7qt2v" Jul 15 15:31:00.210996 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.210962 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd"] Jul 15 15:31:00.214351 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.214331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.218955 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.218919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 15:31:00.219127 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.219109 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 15:31:00.220066 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.220046 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8k27p\"" Jul 15 15:31:00.232924 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.232887 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd"] Jul 15 15:31:00.283289 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.283247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl5c5\" (UniqueName: \"kubernetes.io/projected/74d498b7-efe8-499f-bf3f-b88535f0de9c-kube-api-access-fl5c5\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.283497 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.283369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d498b7-efe8-499f-bf3f-b88535f0de9c-tmp\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.283497 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.283427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74d498b7-efe8-499f-bf3f-b88535f0de9c-tls-certs\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.311529 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.311495 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wv6r5"] Jul 15 15:31:00.315000 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.314974 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.317552 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.317530 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rh8fq\"" Jul 15 15:31:00.317712 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.317693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 15:31:00.334308 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.334277 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wv6r5"] Jul 15 15:31:00.384935 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.384893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4zlt\" (UniqueName: \"kubernetes.io/projected/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-kube-api-access-f4zlt\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.385092 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.384989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d498b7-efe8-499f-bf3f-b88535f0de9c-tmp\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.385092 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.385048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74d498b7-efe8-499f-bf3f-b88535f0de9c-tls-certs\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.385185 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.385092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-cert\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.385185 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.385123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl5c5\" (UniqueName: \"kubernetes.io/projected/74d498b7-efe8-499f-bf3f-b88535f0de9c-kube-api-access-fl5c5\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.387263 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.387238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74d498b7-efe8-499f-bf3f-b88535f0de9c-tmp\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.387510 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.387493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74d498b7-efe8-499f-bf3f-b88535f0de9c-tls-certs\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.396643 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.396617 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl5c5\" (UniqueName: \"kubernetes.io/projected/74d498b7-efe8-499f-bf3f-b88535f0de9c-kube-api-access-fl5c5\") pod \"kube-auth-proxy-c788dcdb-wrtbd\" (UID: \"74d498b7-efe8-499f-bf3f-b88535f0de9c\") " pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.485874 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.485777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-cert\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.485874 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.485839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4zlt\" (UniqueName: \"kubernetes.io/projected/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-kube-api-access-f4zlt\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.486084 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:31:00.485923 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 15:31:00.486084 ip-10-0-140-61 kubenswrapper[2578]: E0715 15:31:00.485998 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-cert podName:80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b nodeName:}" failed. No retries permitted until 2026-07-15 15:31:00.985981468 +0000 UTC m=+417.382219462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-cert") pod "odh-model-controller-7998c67dc4-wv6r5" (UID: "80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b") : secret "odh-model-controller-webhook-cert" not found Jul 15 15:31:00.497753 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.497715 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4zlt\" (UniqueName: \"kubernetes.io/projected/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-kube-api-access-f4zlt\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.523510 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.523459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" Jul 15 15:31:00.666551 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.666512 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd"] Jul 15 15:31:00.670571 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:31:00.670538 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d498b7_efe8_499f_bf3f_b88535f0de9c.slice/crio-d0af66201a6376721fa863606e4616401142b1bb58f2ae338770d56041346c06 WatchSource:0}: Error finding container d0af66201a6376721fa863606e4616401142b1bb58f2ae338770d56041346c06: Status 404 returned error can't find the container with id d0af66201a6376721fa863606e4616401142b1bb58f2ae338770d56041346c06 Jul 15 15:31:00.988822 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.988784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-cert\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:00.991172 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:00.991151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b-cert\") pod \"odh-model-controller-7998c67dc4-wv6r5\" (UID: \"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:01.225595 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:01.225558 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:01.371079 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:01.371045 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wv6r5"] Jul 15 15:31:01.374152 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:31:01.374125 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ebfd35_9c98_49d3_9cb5_5ecb6de06f1b.slice/crio-43cf726a41a7f9bc229509736b7a9d1db7f4ae35f191950b7ee683f7f50d28fe WatchSource:0}: Error finding container 43cf726a41a7f9bc229509736b7a9d1db7f4ae35f191950b7ee683f7f50d28fe: Status 404 returned error can't find the container with id 43cf726a41a7f9bc229509736b7a9d1db7f4ae35f191950b7ee683f7f50d28fe Jul 15 15:31:01.546981 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:01.546894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" event={"ID":"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b","Type":"ContainerStarted","Data":"43cf726a41a7f9bc229509736b7a9d1db7f4ae35f191950b7ee683f7f50d28fe"} Jul 15 15:31:01.547975 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:01.547950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" event={"ID":"74d498b7-efe8-499f-bf3f-b88535f0de9c","Type":"ContainerStarted","Data":"d0af66201a6376721fa863606e4616401142b1bb58f2ae338770d56041346c06"} Jul 15 15:31:05.066055 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:05.066029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 15:31:05.566773 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:05.566728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" event={"ID":"80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b","Type":"ContainerStarted","Data":"c0e321f5a56a10e4526488a8f2b59efe89a39841cd3bd5dcdb3411e44b12355b"} Jul 15 15:31:05.566941 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:05.566834 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:05.568159 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:05.568133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" event={"ID":"74d498b7-efe8-499f-bf3f-b88535f0de9c","Type":"ContainerStarted","Data":"3b31fa45f6520f35e028db763e2d6fbf77a33d92c2ee528cd028d4a34aca7575"} Jul 15 15:31:05.582702 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:05.582623 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" podStartSLOduration=1.894947537 podStartE2EDuration="5.582604841s" totalImagesPullingTime="3.687657304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:05.582315193 +0000 UTC m=+421.978553204" watchObservedRunningTime="2026-07-15 15:31:05.582604841 +0000 UTC m=+421.978842859" Jul 15 15:31:05.600025 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:05.599975 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c788dcdb-wrtbd" podStartSLOduration=1.208859893 podStartE2EDuration="5.599960294s" totalImagesPullingTime="4.391100401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:05.598189345 +0000 UTC m=+421.994427373" watchObservedRunningTime="2026-07-15 15:31:05.599960294 +0000 UTC m=+421.996198309" Jul 15 15:31:07.083975 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.083939 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj"] Jul 15 15:31:07.087598 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.087574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.091110 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.091081 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 15:31:07.091223 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.091181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8rxbr\"" Jul 15 15:31:07.106171 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.106145 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj"] Jul 15 15:31:07.138671 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.138671 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.138866 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.138866 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.138866 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.138866 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.138866 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.139042 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.139042 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.138946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgp8w\" (UniqueName: \"kubernetes.io/projected/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-kube-api-access-kgp8w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.148116 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.148084 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd"] Jul 15 15:31:07.151252 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.151230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.153719 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.153699 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 15:31:07.153833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.153720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qjvh4\"" Jul 15 15:31:07.153833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.153738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 15:31:07.153833 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.153766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 15:31:07.165699 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.165673 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd"] Jul 15 15:31:07.240175 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240175 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgp8w\" (UniqueName: \"kubernetes.io/projected/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-kube-api-access-kgp8w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240428 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.240428 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240428 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240428 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240428 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d51c7d55-6de3-421f-9cd7-6ea42c74083d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.240777 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.241103 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.241103 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md6wl\" (UniqueName: \"kubernetes.io/projected/d51c7d55-6de3-421f-9cd7-6ea42c74083d-kube-api-access-md6wl\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.241103 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.241103 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.240886 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.241103 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.241008 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.241103 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.241085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.241288 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.241230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.242526 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.242494 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.242818 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.242799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.251651 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.251625 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgp8w\" (UniqueName: \"kubernetes.io/projected/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-kube-api-access-kgp8w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.262666 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.262638 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0bb8cfe-6765-4e48-9810-ccf9c5467e72-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vsnlj\" (UID: \"a0bb8cfe-6765-4e48-9810-ccf9c5467e72\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.342261 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.342261 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.342261 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.342261 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d51c7d55-6de3-421f-9cd7-6ea42c74083d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.342613 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.342613 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md6wl\" (UniqueName: \"kubernetes.io/projected/d51c7d55-6de3-421f-9cd7-6ea42c74083d-kube-api-access-md6wl\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.342613 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.342361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.343308 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.343276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.345321 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.345293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d51c7d55-6de3-421f-9cd7-6ea42c74083d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.345321 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.345305 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.345515 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.345314 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.345515 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.345377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d51c7d55-6de3-421f-9cd7-6ea42c74083d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.355318 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.355293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d51c7d55-6de3-421f-9cd7-6ea42c74083d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.358921 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.358897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md6wl\" (UniqueName: \"kubernetes.io/projected/d51c7d55-6de3-421f-9cd7-6ea42c74083d-kube-api-access-md6wl\") pod \"istiod-openshift-gateway-94bb8fbfd-kpknd\" (UID: \"d51c7d55-6de3-421f-9cd7-6ea42c74083d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.399528 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.399494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:07.460642 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.460320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:07.546992 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.546959 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj"] Jul 15 15:31:07.550624 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:31:07.550598 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bb8cfe_6765_4e48_9810_ccf9c5467e72.slice/crio-04b0c66f9624a22a8b2e00346e3caba4f6b32723092662aad4fcd3d362ab820c WatchSource:0}: Error finding container 04b0c66f9624a22a8b2e00346e3caba4f6b32723092662aad4fcd3d362ab820c: Status 404 returned error can't find the container with id 04b0c66f9624a22a8b2e00346e3caba4f6b32723092662aad4fcd3d362ab820c Jul 15 15:31:07.578512 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.578456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" event={"ID":"a0bb8cfe-6765-4e48-9810-ccf9c5467e72","Type":"ContainerStarted","Data":"04b0c66f9624a22a8b2e00346e3caba4f6b32723092662aad4fcd3d362ab820c"} Jul 15 15:31:07.614453 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:07.614425 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd"] Jul 15 15:31:07.616912 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:31:07.616883 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51c7d55_6de3_421f_9cd7_6ea42c74083d.slice/crio-aa68b76f4c80218a5094ff97e65f8cf36d4ddc9a1f20b3082d9efcec748a0d84 WatchSource:0}: Error finding container aa68b76f4c80218a5094ff97e65f8cf36d4ddc9a1f20b3082d9efcec748a0d84: Status 404 returned error can't find the container with id aa68b76f4c80218a5094ff97e65f8cf36d4ddc9a1f20b3082d9efcec748a0d84 Jul 15 15:31:08.585849 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:08.585760 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" event={"ID":"d51c7d55-6de3-421f-9cd7-6ea42c74083d","Type":"ContainerStarted","Data":"aa68b76f4c80218a5094ff97e65f8cf36d4ddc9a1f20b3082d9efcec748a0d84"} Jul 15 15:31:09.437059 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.437016 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w"] Jul 15 15:31:09.444491 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.444446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.449630 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.449540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xbblp\"" Jul 15 15:31:09.449860 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.449838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 15:31:09.450648 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.450310 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 15:31:09.451143 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.451002 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 15:31:09.452109 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.451344 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 15:31:09.452109 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.451572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 15:31:09.455098 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.455057 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w"] Jul 15 15:31:09.461260 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.461217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmb76\" (UniqueName: \"kubernetes.io/projected/7747e768-284f-43b6-b518-64298dd144b7-kube-api-access-dmb76\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.461388 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.461377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7747e768-284f-43b6-b518-64298dd144b7-metrics-cert\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.461485 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.461416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7747e768-284f-43b6-b518-64298dd144b7-manager-config\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.461553 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.461536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7747e768-284f-43b6-b518-64298dd144b7-cert\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.562271 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.562226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7747e768-284f-43b6-b518-64298dd144b7-manager-config\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.562500 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.562286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7747e768-284f-43b6-b518-64298dd144b7-cert\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.562500 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.562361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmb76\" (UniqueName: \"kubernetes.io/projected/7747e768-284f-43b6-b518-64298dd144b7-kube-api-access-dmb76\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.562500 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.562415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7747e768-284f-43b6-b518-64298dd144b7-metrics-cert\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.563114 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.563080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7747e768-284f-43b6-b518-64298dd144b7-manager-config\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.565447 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.565423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7747e768-284f-43b6-b518-64298dd144b7-cert\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.565585 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.565566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7747e768-284f-43b6-b518-64298dd144b7-metrics-cert\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.579456 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.579426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmb76\" (UniqueName: \"kubernetes.io/projected/7747e768-284f-43b6-b518-64298dd144b7-kube-api-access-dmb76\") pod \"lws-controller-manager-6c5d886c95-zsp5w\" (UID: \"7747e768-284f-43b6-b518-64298dd144b7\") " pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:09.759680 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:09.759649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:11.244536 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.244441 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 15:31:11.244807 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.244597 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 15:31:11.244807 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.244643 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 15:31:11.251876 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.251843 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 15:31:11.251986 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.251940 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 15:31:11.389493 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.389439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w"] Jul 15 15:31:11.393188 ip-10-0-140-61 kubenswrapper[2578]: W0715 15:31:11.393132 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7747e768_284f_43b6_b518_64298dd144b7.slice/crio-436d85e40b957c046c636273f467923c63fb7ad54333eb4620a873ccfc1346d5 WatchSource:0}: Error finding container 436d85e40b957c046c636273f467923c63fb7ad54333eb4620a873ccfc1346d5: Status 404 returned error can't find the container with id 436d85e40b957c046c636273f467923c63fb7ad54333eb4620a873ccfc1346d5 Jul 15 15:31:11.604624 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.604532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" event={"ID":"a0bb8cfe-6765-4e48-9810-ccf9c5467e72","Type":"ContainerStarted","Data":"448fbec54ecb30878d1cc7ea2230a07ee72bdb5d299de31b71b1e045d90beda2"} Jul 15 15:31:11.606239 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.606188 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" event={"ID":"d51c7d55-6de3-421f-9cd7-6ea42c74083d","Type":"ContainerStarted","Data":"6b124e5c400f8c9f15b688d2459d9ace4577b4316d6d0b82dbc34edae4fc5c0d"} Jul 15 15:31:11.606347 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.606254 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:11.607512 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.607483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" event={"ID":"7747e768-284f-43b6-b518-64298dd144b7","Type":"ContainerStarted","Data":"436d85e40b957c046c636273f467923c63fb7ad54333eb4620a873ccfc1346d5"} Jul 15 15:31:11.630721 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.630654 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" podStartSLOduration=0.93925642 podStartE2EDuration="4.630629715s" totalImagesPullingTime="3.691373295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:11.628696988 +0000 UTC m=+428.024935018" watchObservedRunningTime="2026-07-15 15:31:11.630629715 +0000 UTC m=+428.026867731" Jul 15 15:31:11.658275 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:11.658221 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" podStartSLOduration=1.025633409 podStartE2EDuration="4.658204133s" totalImagesPullingTime="3.632570724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:11.656672943 +0000 UTC m=+428.052910963" watchObservedRunningTime="2026-07-15 15:31:11.658204133 +0000 UTC m=+428.054442148" Jul 15 15:31:12.400564 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:12.400521 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:12.407284 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:12.407252 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:12.614849 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:12.614819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:12.615803 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:12.615772 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vsnlj" Jul 15 15:31:12.616591 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:12.616572 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kpknd" Jul 15 15:31:14.626166 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:14.626120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" event={"ID":"7747e768-284f-43b6-b518-64298dd144b7","Type":"ContainerStarted","Data":"7f3aea98c8208f392dbc25bd551f91f66d0ce72a64d11166f671db549474c715"} Jul 15 15:31:14.626623 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:14.626290 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:31:14.647911 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:14.647860 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" podStartSLOduration=3.059398181 podStartE2EDuration="5.647843712s" totalImagesPullingTime="2.588445531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:31:14.646370229 +0000 UTC m=+431.042608259" watchObservedRunningTime="2026-07-15 15:31:14.647843712 +0000 UTC m=+431.044081791" Jul 15 15:31:16.575180 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:16.575150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wv6r5" Jul 15 15:31:25.633400 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:31:25.633368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c5d886c95-zsp5w" Jul 15 15:32:04.063796 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:32:04.063768 2578 scope.go:117] "RemoveContainer" containerID="991ab0a62790760d12f1f835c6827d832ddc8ff2f881d7f00a08e1a71ef56c24" Jul 15 15:34:04.059601 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:34:04.059570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:34:04.065040 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:34:04.065015 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:34:04.066088 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:34:04.066070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:34:04.071416 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:34:04.071396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:39:04.095733 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:39:04.095652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:39:04.099239 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:39:04.099209 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:39:04.101659 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:39:04.101635 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:39:04.104968 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:39:04.104945 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:44:04.124880 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:44:04.124854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:44:04.126740 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:44:04.126717 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:44:04.130564 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:44:04.130542 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:44:04.132182 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:44:04.132164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:49:04.157235 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:49:04.157199 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:49:04.159885 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:49:04.157340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:49:04.162609 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:49:04.162587 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:49:04.162770 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:49:04.162754 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:54:04.189168 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:54:04.189039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:54:04.195998 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:54:04.190056 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:54:04.195998 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:54:04.194553 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:54:04.195998 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:54:04.195742 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:59:04.215324 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:59:04.215296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:59:04.217821 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:59:04.217327 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 15:59:04.220972 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:59:04.220949 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 15:59:04.222957 ip-10-0-140-61 kubenswrapper[2578]: I0715 15:59:04.222935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 16:02:31.138802 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.138764 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b"] Jul 15 16:02:31.142182 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.142165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:31.163103 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.163076 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 16:02:31.163918 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.163891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tcg2l\"" Jul 15 16:02:31.164936 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.164915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b"] Jul 15 16:02:31.203026 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.202991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61460b13-1447-4b19-a907-512a2c41b4a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b\" (UID: \"61460b13-1447-4b19-a907-512a2c41b4a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:31.303480 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.303435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61460b13-1447-4b19-a907-512a2c41b4a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b\" (UID: \"61460b13-1447-4b19-a907-512a2c41b4a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:31.304068 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.304046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61460b13-1447-4b19-a907-512a2c41b4a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b\" (UID: \"61460b13-1447-4b19-a907-512a2c41b4a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:31.452621 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.452589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:31.591378 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.591209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b"] Jul 15 16:02:31.594053 ip-10-0-140-61 kubenswrapper[2578]: W0715 16:02:31.594023 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61460b13_1447_4b19_a907_512a2c41b4a8.slice/crio-d7687f9f0b0722011c86e439f4256a1f559e2d00747ca679f556c6451961a163 WatchSource:0}: Error finding container d7687f9f0b0722011c86e439f4256a1f559e2d00747ca679f556c6451961a163: Status 404 returned error can't find the container with id d7687f9f0b0722011c86e439f4256a1f559e2d00747ca679f556c6451961a163 Jul 15 16:02:31.595860 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.595845 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 16:02:31.882673 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:31.882595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" event={"ID":"61460b13-1447-4b19-a907-512a2c41b4a8","Type":"ContainerStarted","Data":"d7687f9f0b0722011c86e439f4256a1f559e2d00747ca679f556c6451961a163"} Jul 15 16:02:34.900406 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:34.900370 2578 generic.go:356] "Generic (PLEG): container finished" podID="61460b13-1447-4b19-a907-512a2c41b4a8" containerID="3d8b14365321a21f2ea138e1c56f17d0b309cc639bb6f8eff1e76262ddf21146" exitCode=0 Jul 15 16:02:34.900832 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:34.900455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" event={"ID":"61460b13-1447-4b19-a907-512a2c41b4a8","Type":"ContainerDied","Data":"3d8b14365321a21f2ea138e1c56f17d0b309cc639bb6f8eff1e76262ddf21146"} Jul 15 16:02:36.034753 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.034725 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:36.144304 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.144268 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61460b13-1447-4b19-a907-512a2c41b4a8-maas-api-service-ca\") pod \"61460b13-1447-4b19-a907-512a2c41b4a8\" (UID: \"61460b13-1447-4b19-a907-512a2c41b4a8\") " Jul 15 16:02:36.144639 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.144615 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61460b13-1447-4b19-a907-512a2c41b4a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61460b13-1447-4b19-a907-512a2c41b4a8" (UID: "61460b13-1447-4b19-a907-512a2c41b4a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:02:36.245432 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.245391 2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61460b13-1447-4b19-a907-512a2c41b4a8-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:02:36.911024 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.910985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" event={"ID":"61460b13-1447-4b19-a907-512a2c41b4a8","Type":"ContainerDied","Data":"d7687f9f0b0722011c86e439f4256a1f559e2d00747ca679f556c6451961a163"} Jul 15 16:02:36.911024 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.911013 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b" Jul 15 16:02:36.911231 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:02:36.911039 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7687f9f0b0722011c86e439f4256a1f559e2d00747ca679f556c6451961a163" Jul 15 16:03:33.813572 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.813533 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls"] Jul 15 16:03:33.814036 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.813926 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61460b13-1447-4b19-a907-512a2c41b4a8" containerName="revoke-keys" Jul 15 16:03:33.814036 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.813938 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="61460b13-1447-4b19-a907-512a2c41b4a8" containerName="revoke-keys" Jul 15 16:03:33.814036 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.813994 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="61460b13-1447-4b19-a907-512a2c41b4a8" containerName="revoke-keys" Jul 15 16:03:33.817137 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.817119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.820141 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.820107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-552a11-openshift-default-dockercfg-qfs7g\"" Jul 15 16:03:33.849393 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.849367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls"] Jul 15 16:03:33.928409 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-token\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928610 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-certs\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928610 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-credential-socket\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928610 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-podinfo\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928610 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-socket\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928610 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-envoy\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928610 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-data\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928914 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istiod-ca-cert\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:33.928914 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:33.928816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxwxf\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-kube-api-access-zxwxf\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.029833 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.029796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-envoy\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.029833 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.029830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-data\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.029858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istiod-ca-cert\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.029901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxwxf\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-kube-api-access-zxwxf\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.029939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-token\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.029971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-certs\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-credential-socket\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-podinfo\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030088 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-socket\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030424 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-data\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030590 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-certs\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030686 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-credential-socket\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030755 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030734 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istiod-ca-cert\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.030798 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.030788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-socket\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.032247 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.032215 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-envoy\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.032520 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.032501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-podinfo\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.044553 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.044529 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxwxf\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-kube-api-access-zxwxf\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.046132 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.046114 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-token\") pod \"e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.127726 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.127638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:34.280754 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.280725 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls"] Jul 15 16:03:34.282848 ip-10-0-140-61 kubenswrapper[2578]: W0715 16:03:34.282821 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd413c526_4100_4d75_8f6c_0c9615fbb7ac.slice/crio-6af63ff21ab004c9748a95381e6bcf63233a8f524d24cb5f872bca8b16c6be0d WatchSource:0}: Error finding container 6af63ff21ab004c9748a95381e6bcf63233a8f524d24cb5f872bca8b16c6be0d: Status 404 returned error can't find the container with id 6af63ff21ab004c9748a95381e6bcf63233a8f524d24cb5f872bca8b16c6be0d Jul 15 16:03:34.284958 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.284920 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:03:34.285042 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.284992 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:03:34.285042 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:34.285022 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:03:35.168760 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:35.168725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" event={"ID":"d413c526-4100-4d75-8f6c-0c9615fbb7ac","Type":"ContainerStarted","Data":"866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392"} Jul 15 16:03:35.169151 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:35.168777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" event={"ID":"d413c526-4100-4d75-8f6c-0c9615fbb7ac","Type":"ContainerStarted","Data":"6af63ff21ab004c9748a95381e6bcf63233a8f524d24cb5f872bca8b16c6be0d"} Jul 15 16:03:35.198078 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:35.198020 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podStartSLOduration=2.198004463 podStartE2EDuration="2.198004463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:03:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:03:35.19559615 +0000 UTC m=+2371.591834166" watchObservedRunningTime="2026-07-15 16:03:35.198004463 +0000 UTC m=+2371.594242509" Jul 15 16:03:36.128514 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:36.128448 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:36.133650 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:36.133622 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:36.172824 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:36.172798 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:36.173917 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:36.173898 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:52.214664 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:52.214616 2578 patch_prober.go:28] interesting pod/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 16:03:52.215084 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:52.214706 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 16:03:54.261592 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:54.261560 2578 generic.go:356] "Generic (PLEG): container finished" podID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerID="866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392" exitCode=0 Jul 15 16:03:54.261592 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:54.261598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" event={"ID":"d413c526-4100-4d75-8f6c-0c9615fbb7ac","Type":"ContainerDied","Data":"866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392"} Jul 15 16:03:54.262056 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:54.261980 2578 scope.go:117] "RemoveContainer" containerID="866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392" Jul 15 16:03:54.262980 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:54.262947 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:03:54.263036 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:54.263021 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:03:54.263067 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:54.263054 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:03:55.267724 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:55.267691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" event={"ID":"d413c526-4100-4d75-8f6c-0c9615fbb7ac","Type":"ContainerStarted","Data":"f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b"} Jul 15 16:03:56.128760 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:56.128724 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:56.129122 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:56.129097 2578 patch_prober.go:28] interesting pod/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 15 16:03:56.129275 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:56.129251 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 15 16:03:57.129004 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:57.128953 2578 patch_prober.go:28] interesting pod/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 15 16:03:57.130219 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:57.130168 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 15 16:03:58.129119 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:58.129079 2578 patch_prober.go:28] interesting pod/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 15 16:03:58.129761 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:58.129728 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 15 16:03:59.131363 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:59.131334 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:59.131762 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:59.131732 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:03:59.132449 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:03:59.132428 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:04:04.242582 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:04.242552 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 16:04:04.245070 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:04.245045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 16:04:04.247855 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:04.247835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 16:04:04.250670 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:04.250647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 16:04:42.224075 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:42.224036 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls"] Jul 15 16:04:42.224661 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:42.224323 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" containerID="cri-o://f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b" gracePeriod=30 Jul 15 16:04:44.133708 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:44.133669 2578 patch_prober.go:28] interesting pod/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 16:04:44.134110 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:44.133721 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 16:04:47.481724 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.481696 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:04:47.515862 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.515772 2578 generic.go:356] "Generic (PLEG): container finished" podID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerID="f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b" exitCode=0 Jul 15 16:04:47.515862 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.515824 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" Jul 15 16:04:47.516100 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.515858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" event={"ID":"d413c526-4100-4d75-8f6c-0c9615fbb7ac","Type":"ContainerDied","Data":"f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b"} Jul 15 16:04:47.516100 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.515927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls" event={"ID":"d413c526-4100-4d75-8f6c-0c9615fbb7ac","Type":"ContainerDied","Data":"6af63ff21ab004c9748a95381e6bcf63233a8f524d24cb5f872bca8b16c6be0d"} Jul 15 16:04:47.516100 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.515956 2578 scope.go:117] "RemoveContainer" containerID="f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b" Jul 15 16:04:47.526229 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.526213 2578 scope.go:117] "RemoveContainer" containerID="866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392" Jul 15 16:04:47.535987 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.535969 2578 scope.go:117] "RemoveContainer" containerID="f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b" Jul 15 16:04:47.536290 ip-10-0-140-61 kubenswrapper[2578]: E0715 16:04:47.536271 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b\": container with ID starting with f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b not found: ID does not exist" containerID="f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b" Jul 15 16:04:47.536363 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.536309 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b"} err="failed to get container status \"f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b\": rpc error: code = NotFound desc = could not find container \"f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b\": container with ID starting with f95eb3b99bf655272139a8a55571bf7eceee98bb9fab9ab94ef3aace49c45d2b not found: ID does not exist" Jul 15 16:04:47.536363 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.536327 2578 scope.go:117] "RemoveContainer" containerID="866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392" Jul 15 16:04:47.536607 ip-10-0-140-61 kubenswrapper[2578]: E0715 16:04:47.536585 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392\": container with ID starting with 866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392 not found: ID does not exist" containerID="866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392" Jul 15 16:04:47.536658 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.536617 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392"} err="failed to get container status \"866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392\": rpc error: code = NotFound desc = could not find container \"866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392\": container with ID starting with 866ffbf2c2caba29cc5d7dcd2ebb7975e3c2115965e674ae25d1ace6d7353392 not found: ID does not exist" Jul 15 16:04:47.580748 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.580714 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istiod-ca-cert\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.580950 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.580787 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-credential-socket\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.580950 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.580814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-socket\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.580950 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.580903 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-token\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.580950 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.580950 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-data\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.581166 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581014 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxwxf\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-kube-api-access-zxwxf\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.581166 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581069 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-certs\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.581166 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581083 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:04:47.581166 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581104 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-envoy\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.581166 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581104 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:04:47.581166 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581143 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-podinfo\") pod \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\" (UID: \"d413c526-4100-4d75-8f6c-0c9615fbb7ac\") " Jul 15 16:04:47.581493 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581178 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:04:47.581493 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581318 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:04:47.581493 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581482 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-socket\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.581669 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581499 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-workload-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.581669 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581513 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istiod-ca-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.581669 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581523 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-credential-socket\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.581822 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.581789 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:04:47.583514 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.583483 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:04:47.583634 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.583543 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-kube-api-access-zxwxf" (OuterVolumeSpecName: "kube-api-access-zxwxf") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "kube-api-access-zxwxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:04:47.583695 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.583620 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:04:47.583746 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.583699 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d413c526-4100-4d75-8f6c-0c9615fbb7ac" (UID: "d413c526-4100-4d75-8f6c-0c9615fbb7ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 16:04:47.682618 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.682575 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-data\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.682618 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.682616 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxwxf\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-kube-api-access-zxwxf\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.682819 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.682630 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-envoy\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.682819 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.682643 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-podinfo\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.682819 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.682655 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d413c526-4100-4d75-8f6c-0c9615fbb7ac-istio-token\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:04:47.832696 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.832659 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls"] Jul 15 16:04:47.842687 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:47.842651 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-552a11-openshift-default-6bc8d9d47f-j95ls"] Jul 15 16:04:49.782570 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:49.782511 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" path="/var/lib/kubelet/pods/d413c526-4100-4d75-8f6c-0c9615fbb7ac/volumes" Jul 15 16:04:51.117519 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.117480 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs"] Jul 15 16:04:51.118023 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.118004 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" Jul 15 16:04:51.118023 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.118023 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" Jul 15 16:04:51.118133 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.118124 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" Jul 15 16:04:51.122478 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.122441 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.125717 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.125693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bcb615-openshift-default-dockercfg-swcp5\"" Jul 15 16:04:51.136423 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.136394 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs"] Jul 15 16:04:51.212404 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-data\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212404 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-istio-token\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b31445-a190-4d12-a64a-8dcfe1898287-istio-podinfo\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6b2p\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-kube-api-access-l6b2p\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b31445-a190-4d12-a64a-8dcfe1898287-istiod-ca-cert\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-credential-socket\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-certs\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-socket\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.212638 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.212635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-envoy\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313212 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-socket\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313212 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-envoy\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-data\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-istio-token\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b31445-a190-4d12-a64a-8dcfe1898287-istio-podinfo\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6b2p\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-kube-api-access-l6b2p\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b31445-a190-4d12-a64a-8dcfe1898287-istiod-ca-cert\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-credential-socket\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313481 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-certs\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313830 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313641 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-socket\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313830 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313655 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-data\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313938 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-certs\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.313992 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.313960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-credential-socket\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.314341 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.314312 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b31445-a190-4d12-a64a-8dcfe1898287-istiod-ca-cert\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.316194 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.316150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-envoy\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.316316 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.316295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b31445-a190-4d12-a64a-8dcfe1898287-istio-podinfo\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.321779 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.321753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6b2p\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-kube-api-access-l6b2p\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.321876 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.321838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-istio-token\") pod \"e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.432626 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.432535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:51.575600 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.575572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs"] Jul 15 16:04:51.578548 ip-10-0-140-61 kubenswrapper[2578]: W0715 16:04:51.578520 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b31445_a190_4d12_a64a_8dcfe1898287.slice/crio-97970806e3040c23de2d8414f7bad9464e10c3354d32ea9d23cc2b33879fea38 WatchSource:0}: Error finding container 97970806e3040c23de2d8414f7bad9464e10c3354d32ea9d23cc2b33879fea38: Status 404 returned error can't find the container with id 97970806e3040c23de2d8414f7bad9464e10c3354d32ea9d23cc2b33879fea38 Jul 15 16:04:51.580906 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.580874 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:04:51.580971 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.580939 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:04:51.581008 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:51.580969 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:04:52.543409 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:52.543375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" event={"ID":"71b31445-a190-4d12-a64a-8dcfe1898287","Type":"ContainerStarted","Data":"b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec"} Jul 15 16:04:52.543823 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:52.543431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" event={"ID":"71b31445-a190-4d12-a64a-8dcfe1898287","Type":"ContainerStarted","Data":"97970806e3040c23de2d8414f7bad9464e10c3354d32ea9d23cc2b33879fea38"} Jul 15 16:04:52.568677 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:52.568626 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podStartSLOduration=1.568604791 podStartE2EDuration="1.568604791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:04:52.565761036 +0000 UTC m=+2448.961999052" watchObservedRunningTime="2026-07-15 16:04:52.568604791 +0000 UTC m=+2448.964842809" Jul 15 16:04:53.433551 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:53.433515 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:53.438568 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:53.438539 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:53.548756 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:53.548727 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:04:53.549612 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:04:53.549591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:05:08.550126 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.550088 2578 patch_prober.go:28] interesting pod/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 15 16:05:08.550553 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.550148 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 15 16:05:08.616644 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.616608 2578 generic.go:356] "Generic (PLEG): container finished" podID="71b31445-a190-4d12-a64a-8dcfe1898287" containerID="b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec" exitCode=0 Jul 15 16:05:08.616818 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.616680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" event={"ID":"71b31445-a190-4d12-a64a-8dcfe1898287","Type":"ContainerDied","Data":"b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec"} Jul 15 16:05:08.617101 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.617088 2578 scope.go:117] "RemoveContainer" containerID="b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec" Jul 15 16:05:08.618125 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.618097 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:05:08.618230 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.618180 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:05:08.618289 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:08.618232 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 16:05:09.625492 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:09.623915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" event={"ID":"71b31445-a190-4d12-a64a-8dcfe1898287","Type":"ContainerStarted","Data":"10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664"} Jul 15 16:05:10.432987 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:10.432939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:05:10.433291 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:10.433261 2578 patch_prober.go:28] interesting pod/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 15 16:05:10.433372 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:10.433326 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 15 16:05:11.433363 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:11.433319 2578 patch_prober.go:28] interesting pod/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 15 16:05:11.434132 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:11.434091 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 15 16:05:12.434310 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:12.433880 2578 patch_prober.go:28] interesting pod/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 15 16:05:12.434310 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:12.433946 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 15 16:05:13.433232 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:13.433191 2578 patch_prober.go:28] interesting pod/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 15 16:05:13.433414 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:13.433282 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 15 16:05:14.436946 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:14.436913 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:05:14.437304 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:14.437184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:05:14.437782 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:05:14.437766 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:09:04.269990 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:09:04.269916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 16:09:04.272352 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:09:04.272325 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 16:09:04.275153 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:09:04.275130 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 16:09:04.277516 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:09:04.277495 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjvh7_bb12d90a-500c-454e-8e30-f474d6973514/ovn-acl-logging/0.log" Jul 15 16:12:12.035066 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:12.034977 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs"] Jul 15 16:12:12.035571 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:12.035226 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" containerID="cri-o://10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664" gracePeriod=30 Jul 15 16:12:14.439856 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:14.439813 2578 patch_prober.go:28] interesting pod/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 16:12:14.440265 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:14.439874 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 16:12:17.293123 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.293095 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:12:17.465716 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465678 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b31445-a190-4d12-a64a-8dcfe1898287-istio-podinfo\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465716 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465726 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b31445-a190-4d12-a64a-8dcfe1898287-istiod-ca-cert\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465745 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-certs\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465769 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-socket\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465834 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-data\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465879 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-istio-token\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465900 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-envoy\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.465962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465934 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-credential-socket\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.466231 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.465999 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:12:17.466231 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.466032 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6b2p\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-kube-api-access-l6b2p\") pod \"71b31445-a190-4d12-a64a-8dcfe1898287\" (UID: \"71b31445-a190-4d12-a64a-8dcfe1898287\") " Jul 15 16:12:17.466231 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.466072 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:12:17.466371 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.466250 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:12:17.466371 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.466310 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.466371 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.466331 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-workload-socket\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.466527 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.466444 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b31445-a190-4d12-a64a-8dcfe1898287-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 16:12:17.467296 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.467267 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-data" (OuterVolumeSpecName: "istio-data") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:12:17.468232 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.468202 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 16:12:17.468232 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.468219 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71b31445-a190-4d12-a64a-8dcfe1898287-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 16:12:17.468643 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.468608 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-kube-api-access-l6b2p" (OuterVolumeSpecName: "kube-api-access-l6b2p") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "kube-api-access-l6b2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:12:17.468643 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.468616 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-istio-token" (OuterVolumeSpecName: "istio-token") pod "71b31445-a190-4d12-a64a-8dcfe1898287" (UID: "71b31445-a190-4d12-a64a-8dcfe1898287"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 16:12:17.566964 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.566927 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-istio-token\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.566964 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.566958 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-envoy\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.566964 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.566967 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-credential-socket\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.566964 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.566978 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6b2p\" (UniqueName: \"kubernetes.io/projected/71b31445-a190-4d12-a64a-8dcfe1898287-kube-api-access-l6b2p\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.567235 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.566988 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b31445-a190-4d12-a64a-8dcfe1898287-istio-podinfo\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.567235 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.566997 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b31445-a190-4d12-a64a-8dcfe1898287-istiod-ca-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.567235 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.567005 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b31445-a190-4d12-a64a-8dcfe1898287-istio-data\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 15 16:12:17.582676 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.582639 2578 generic.go:356] "Generic (PLEG): container finished" podID="71b31445-a190-4d12-a64a-8dcfe1898287" containerID="10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664" exitCode=0 Jul 15 16:12:17.582852 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.582698 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" Jul 15 16:12:17.582852 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.582702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" event={"ID":"71b31445-a190-4d12-a64a-8dcfe1898287","Type":"ContainerDied","Data":"10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664"} Jul 15 16:12:17.582852 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.582832 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs" event={"ID":"71b31445-a190-4d12-a64a-8dcfe1898287","Type":"ContainerDied","Data":"97970806e3040c23de2d8414f7bad9464e10c3354d32ea9d23cc2b33879fea38"} Jul 15 16:12:17.582998 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.582864 2578 scope.go:117] "RemoveContainer" containerID="10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664" Jul 15 16:12:17.593334 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.593306 2578 scope.go:117] "RemoveContainer" containerID="b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec" Jul 15 16:12:17.601447 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.601426 2578 scope.go:117] "RemoveContainer" containerID="10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664" Jul 15 16:12:17.601972 ip-10-0-140-61 kubenswrapper[2578]: E0715 16:12:17.601824 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664\": container with ID starting with 10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664 not found: ID does not exist" containerID="10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664" Jul 15 16:12:17.601972 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.601863 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664"} err="failed to get container status \"10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664\": rpc error: code = NotFound desc = could not find container \"10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664\": container with ID starting with 10043c94d2875f4377c01a33f7807b20db754e73270dede5860fc398e594b664 not found: ID does not exist" Jul 15 16:12:17.601972 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.601889 2578 scope.go:117] "RemoveContainer" containerID="b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec" Jul 15 16:12:17.602677 ip-10-0-140-61 kubenswrapper[2578]: E0715 16:12:17.602236 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec\": container with ID starting with b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec not found: ID does not exist" containerID="b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec" Jul 15 16:12:17.602677 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.602266 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec"} err="failed to get container status \"b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec\": rpc error: code = NotFound desc = could not find container \"b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec\": container with ID starting with b39d2ea542262fa53dfb5d8b557192ef007c6fd2fb8ee1aa5f3056ce8d9097ec not found: ID does not exist" Jul 15 16:12:17.604052 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.604030 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs"] Jul 15 16:12:17.609916 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.609891 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bcb615-openshift-default-544d964dc5-cz6bs"] Jul 15 16:12:17.777477 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:17.777378 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" path="/var/lib/kubelet/pods/71b31445-a190-4d12-a64a-8dcfe1898287/volumes" Jul 15 16:12:18.524986 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:18.524956 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wv6r5_80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b/manager/0.log" Jul 15 16:12:18.640829 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:18.640804 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-7qt2v_d6691a46-fe9d-4732-91a1-b3a0d101b310/copy-manifests/0.log" Jul 15 16:12:18.647844 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:18.647812 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-7qt2v_d6691a46-fe9d-4732-91a1-b3a0d101b310/manager/0.log" Jul 15 16:12:20.230161 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:20.230126 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-a920e4-h8k8b_61460b13-1447-4b19-a907-512a2c41b4a8/revoke-keys/0.log" Jul 15 16:12:23.633423 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:23.633395 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vsnlj_a0bb8cfe-6765-4e48-9810-ccf9c5467e72/istio-proxy/0.log" Jul 15 16:12:23.747677 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:23.747637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kpknd_d51c7d55-6de3-421f-9cd7-6ea42c74083d/discovery/0.log" Jul 15 16:12:23.973386 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:23.973329 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-wrtbd_74d498b7-efe8-499f-bf3f-b88535f0de9c/kube-auth-proxy/0.log" Jul 15 16:12:24.479960 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:24.479931 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf84888f8-pmgqc_6b9c7276-1361-4efd-89eb-f3bf081580e3/router/0.log" Jul 15 16:12:33.697879 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:33.697846 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6dmst_fb418a97-fe69-4a50-9015-404b32a84be7/global-pull-secret-syncer/0.log" Jul 15 16:12:33.907363 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:33.907333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sckf5_77822ba7-7d2b-457a-bcc8-228794784c04/konnectivity-agent/0.log" Jul 15 16:12:33.978677 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:33.978651 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-61.ec2.internal_5c90a46431eae6b3cdd7f5745d0d2187/haproxy/0.log" Jul 15 16:12:40.710555 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:40.710516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-bp6fv_abb01889-fff5-4566-8bf0-f8eed82ce3e9/cluster-monitoring-operator/0.log" Jul 15 16:12:41.023981 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.023954 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gnc8n_159cd406-27bf-4a49-8d43-97332c386c5a/node-exporter/0.log" Jul 15 16:12:41.048279 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.048253 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gnc8n_159cd406-27bf-4a49-8d43-97332c386c5a/kube-rbac-proxy/0.log" Jul 15 16:12:41.074446 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.074418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gnc8n_159cd406-27bf-4a49-8d43-97332c386c5a/init-textfile/0.log" Jul 15 16:12:41.273012 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.272936 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/prometheus/0.log" Jul 15 16:12:41.297160 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.297132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/config-reloader/0.log" Jul 15 16:12:41.320923 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.320901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/thanos-sidecar/0.log" Jul 15 16:12:41.344628 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.344600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/kube-rbac-proxy-web/0.log" Jul 15 16:12:41.366493 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.366448 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/kube-rbac-proxy/0.log" Jul 15 16:12:41.388772 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.388743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/kube-rbac-proxy-thanos/0.log" Jul 15 16:12:41.410275 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:41.410248 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0743c9dd-3b9e-43bc-9b70-f517a7ebc143/init-config-reloader/0.log" Jul 15 16:12:43.001700 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.001661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-rtw7x_72184120-1f18-44ea-8be4-b503a7e1fffd/networking-console-plugin/0.log" Jul 15 16:12:43.644630 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.644601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/1.log" Jul 15 16:12:43.648819 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.648798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rc6rf_cab6c8f6-4bf6-4d26-a3d0-ba461c782745/console-operator/2.log" Jul 15 16:12:43.662229 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662194 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq"] Jul 15 16:12:43.662620 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662602 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" Jul 15 16:12:43.662712 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662621 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" Jul 15 16:12:43.662712 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662639 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" Jul 15 16:12:43.662712 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662647 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" Jul 15 16:12:43.662712 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662659 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" Jul 15 16:12:43.662712 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662667 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" Jul 15 16:12:43.662949 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662753 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b31445-a190-4d12-a64a-8dcfe1898287" containerName="istio-proxy" Jul 15 16:12:43.662949 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.662766 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d413c526-4100-4d75-8f6c-0c9615fbb7ac" containerName="istio-proxy" Jul 15 16:12:43.667321 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.667299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.669726 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.669705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xf74v\"/\"default-dockercfg-76hpf\"" Jul 15 16:12:43.669948 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.669915 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xf74v\"/\"kube-root-ca.crt\"" Jul 15 16:12:43.670023 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.669941 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xf74v\"/\"openshift-service-ca.crt\"" Jul 15 16:12:43.675448 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.675426 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq"] Jul 15 16:12:43.795711 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.795675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-proc\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.795894 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.795728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-lib-modules\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.795894 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.795799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kkht\" (UniqueName: \"kubernetes.io/projected/81a70673-323d-4fad-86cc-6f176ba49e03-kube-api-access-7kkht\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.795894 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.795840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-podres\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.795894 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.795887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-sys\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897368 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-proc\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897368 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-lib-modules\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897368 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkht\" (UniqueName: \"kubernetes.io/projected/81a70673-323d-4fad-86cc-6f176ba49e03-kube-api-access-7kkht\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897690 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-podres\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897690 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897398 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-proc\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897690 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-sys\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897690 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-sys\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897690 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897558 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-lib-modules\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.897690 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.897566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81a70673-323d-4fad-86cc-6f176ba49e03-podres\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.906429 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.906403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkht\" (UniqueName: \"kubernetes.io/projected/81a70673-323d-4fad-86cc-6f176ba49e03-kube-api-access-7kkht\") pod \"perf-node-gather-daemonset-9gcdq\" (UID: \"81a70673-323d-4fad-86cc-6f176ba49e03\") " pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:43.978178 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:43.978142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:44.114674 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.114642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq"] Jul 15 16:12:44.117895 ip-10-0-140-61 kubenswrapper[2578]: W0715 16:12:44.117864 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81a70673_323d_4fad_86cc_6f176ba49e03.slice/crio-bc5d52edf001678e8affb599f5ad86cd9708c68a5098b8f43318f0a5c32b4abf WatchSource:0}: Error finding container bc5d52edf001678e8affb599f5ad86cd9708c68a5098b8f43318f0a5c32b4abf: Status 404 returned error can't find the container with id bc5d52edf001678e8affb599f5ad86cd9708c68a5098b8f43318f0a5c32b4abf Jul 15 16:12:44.315021 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.314989 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-b5r6x_27216988-e5c2-4e8f-9c08-05cfa7a1c64a/download-server/0.log" Jul 15 16:12:44.711262 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.711227 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" event={"ID":"81a70673-323d-4fad-86cc-6f176ba49e03","Type":"ContainerStarted","Data":"247367feffa03ff52c8743b88ebcb9c8bd0987f0afe671a1e21b6b0702a1ada8"} Jul 15 16:12:44.711436 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.711282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" event={"ID":"81a70673-323d-4fad-86cc-6f176ba49e03","Type":"ContainerStarted","Data":"bc5d52edf001678e8affb599f5ad86cd9708c68a5098b8f43318f0a5c32b4abf"} Jul 15 16:12:44.711436 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.711358 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:44.729554 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.729501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" podStartSLOduration=1.729483408 podStartE2EDuration="1.729483408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:44.728297915 +0000 UTC m=+2921.124535933" watchObservedRunningTime="2026-07-15 16:12:44.729483408 +0000 UTC m=+2921.125721415" Jul 15 16:12:44.940607 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:44.940582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-jm5sg_a00c0c57-b380-4103-abc9-e765c7daac2e/volume-data-source-validator/0.log" Jul 15 16:12:46.047775 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:46.047739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w4tqc_55a995c9-c058-4dd7-9dc4-4a7dd887349d/dns/0.log" Jul 15 16:12:46.068451 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:46.068423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w4tqc_55a995c9-c058-4dd7-9dc4-4a7dd887349d/kube-rbac-proxy/0.log" Jul 15 16:12:46.139982 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:46.139953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x88n8_eb7b119e-8b61-4544-af4f-41f460f2469c/dns-node-resolver/0.log" Jul 15 16:12:46.736439 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:46.736407 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zp67h_a439729b-98ab-4fdb-b9fb-b5384c0a1588/node-ca/0.log" Jul 15 16:12:47.665044 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:47.665012 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vsnlj_a0bb8cfe-6765-4e48-9810-ccf9c5467e72/istio-proxy/0.log" Jul 15 16:12:47.787991 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:47.787955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kpknd_d51c7d55-6de3-421f-9cd7-6ea42c74083d/discovery/0.log" Jul 15 16:12:47.842918 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:47.842889 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-wrtbd_74d498b7-efe8-499f-bf3f-b88535f0de9c/kube-auth-proxy/0.log" Jul 15 16:12:48.035183 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:48.035149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf84888f8-pmgqc_6b9c7276-1361-4efd-89eb-f3bf081580e3/router/0.log" Jul 15 16:12:48.784608 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:48.784559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sv5mr_5e259c1b-9c11-4422-a13f-9d386d07a847/serve-healthcheck-canary/0.log" Jul 15 16:12:49.249264 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:49.249231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6mxld_db0a5b5a-26a3-4d18-a2f2-54e6954eec56/insights-operator/0.log" Jul 15 16:12:49.249784 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:49.249767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6mxld_db0a5b5a-26a3-4d18-a2f2-54e6954eec56/insights-operator/1.log" Jul 15 16:12:49.419922 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:49.419893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gn277_47cf9a99-da95-4506-bccf-d64e2918e96a/kube-rbac-proxy/0.log" Jul 15 16:12:49.441383 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:49.441352 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gn277_47cf9a99-da95-4506-bccf-d64e2918e96a/exporter/0.log" Jul 15 16:12:49.463603 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:49.463575 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gn277_47cf9a99-da95-4506-bccf-d64e2918e96a/extractor/0.log" Jul 15 16:12:50.726723 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:50.726698 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xf74v/perf-node-gather-daemonset-9gcdq" Jul 15 16:12:51.998077 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:51.998042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wv6r5_80ebfd35-9c98-49d3-9cb5-5ecb6de06f1b/manager/0.log" Jul 15 16:12:52.024250 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:52.024206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-7qt2v_d6691a46-fe9d-4732-91a1-b3a0d101b310/manager/0.log" Jul 15 16:12:52.045027 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:52.044996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-997df6bcb-7qt2v_d6691a46-fe9d-4732-91a1-b3a0d101b310/copy-manifests/0.log" Jul 15 16:12:53.684450 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:53.684378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c5d886c95-zsp5w_7747e768-284f-43b6-b518-64298dd144b7/manager/0.log" Jul 15 16:12:54.385644 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:54.385620 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vsnlj_a0bb8cfe-6765-4e48-9810-ccf9c5467e72/istio-proxy/0.log" Jul 15 16:12:54.504405 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:54.504368 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kpknd_d51c7d55-6de3-421f-9cd7-6ea42c74083d/discovery/0.log" Jul 15 16:12:54.529782 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:54.529748 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-wrtbd_74d498b7-efe8-499f-bf3f-b88535f0de9c/kube-auth-proxy/0.log" Jul 15 16:12:54.684835 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:54.684752 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf84888f8-pmgqc_6b9c7276-1361-4efd-89eb-f3bf081580e3/router/0.log" Jul 15 16:12:56.038219 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:56.038185 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vsnlj_a0bb8cfe-6765-4e48-9810-ccf9c5467e72/istio-proxy/0.log" Jul 15 16:12:56.150164 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:56.150131 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kpknd_d51c7d55-6de3-421f-9cd7-6ea42c74083d/discovery/0.log" Jul 15 16:12:56.178544 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:56.178516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c788dcdb-wrtbd_74d498b7-efe8-499f-bf3f-b88535f0de9c/kube-auth-proxy/0.log" Jul 15 16:12:56.343588 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:56.343518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf84888f8-pmgqc_6b9c7276-1361-4efd-89eb-f3bf081580e3/router/0.log" Jul 15 16:12:59.174850 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:59.174820 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7pscr_166bfde5-78e1-4753-8d35-4a945452b5ef/kube-storage-version-migrator-operator/1.log" Jul 15 16:12:59.175772 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:12:59.175757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7pscr_166bfde5-78e1-4753-8d35-4a945452b5ef/kube-storage-version-migrator-operator/0.log" Jul 15 16:13:00.566962 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.566931 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/kube-multus-additional-cni-plugins/0.log" Jul 15 16:13:00.612325 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.612296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/egress-router-binary-copy/0.log" Jul 15 16:13:00.649516 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.649487 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/cni-plugins/0.log" Jul 15 16:13:00.694672 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.694645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/bond-cni-plugin/0.log" Jul 15 16:13:00.717796 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.717761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/routeoverride-cni/0.log" Jul 15 16:13:00.740090 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.740055 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/whereabouts-cni-bincopy/0.log" Jul 15 16:13:00.763580 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.763555 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w2skh_679976f1-1adc-4c70-8d10-c889855553b9/whereabouts-cni/0.log" Jul 15 16:13:00.891032 ip-10-0-140-61 kubenswrapper[2578]: I0715 16:13:00.890955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qs9jt_40703c45-bfd0-4618-80fb-02cad93682cc/kube-multus/0.log"