Jul 13 03:39:31.246145 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 03:39:31.246159 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 03:39:31.246169 ip-10-0-138-160 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 03:39:31.246488 ip-10-0-138-160 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 03:39:41.348054 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 03:39:41.348068 ip-10-0-138-160 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fb0b98c5c7e54c3cabca4a814ebaa739 -- Jul 13 03:41:09.252790 ip-10-0-138-160 systemd[1]: Starting Kubernetes Kubelet... Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.716311 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720477 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720503 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720507 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720510 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720514 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720516 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720521 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 13 03:41:09.768411 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720527 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720531 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720534 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720537 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720539 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720549 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720552 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720554 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720557 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720560 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720562 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720565 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720568 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720570 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720573 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720575 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720578 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720581 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720583 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720586 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 03:41:09.771563 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720588 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720591 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720593 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720596 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720599 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720601 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720604 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720606 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720609 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720611 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720614 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720617 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720619 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720622 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720625 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720627 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720630 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720633 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720635 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720638 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 03:41:09.775325 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720641 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720643 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720646 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720648 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720650 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720655 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720659 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720661 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720667 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720670 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720673 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720675 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720678 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720680 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720683 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720686 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720689 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720691 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720693 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 03:41:09.778179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720696 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720699 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720701 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720704 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720707 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720711 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720713 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720716 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720719 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720721 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720724 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720726 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720729 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720734 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720737 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720739 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720742 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720744 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720747 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 03:41:09.781758 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720751 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720754 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720759 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720762 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720765 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720768 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720770 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720773 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720776 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720779 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720782 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720784 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720787 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.720789 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721525 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721534 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721538 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721541 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721546 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 03:41:09.785041 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721551 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721554 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721557 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721560 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721563 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721566 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721569 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721572 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721574 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721577 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721579 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721582 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721584 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721587 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721590 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721596 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721599 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721601 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721604 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721607 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 03:41:09.789279 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721610 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721613 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721616 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721619 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721622 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721625 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721627 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721630 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721632 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721635 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721638 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721640 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721643 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721650 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721652 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721656 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721658 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721661 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721663 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721666 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 03:41:09.792367 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721669 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721671 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721681 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721685 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721689 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721692 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721694 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721698 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721701 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721703 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721706 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721708 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721711 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721713 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721716 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721719 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721721 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721724 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721726 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721729 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 03:41:09.796025 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721733 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721736 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721739 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721742 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721744 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721747 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721750 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721755 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721758 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721761 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721764 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721767 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721769 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721772 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721774 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721777 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721779 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721782 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721784 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 03:41:09.799321 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721788 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 03:41:09.796874 ip-10-0-138-160 systemd[1]: Started Kubernetes Kubelet. Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721791 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721793 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721796 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721799 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721801 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721804 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721806 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721809 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721811 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721814 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721817 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721820 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721822 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.721824 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722206 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722211 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722213 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722216 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 03:41:09.805686 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722225 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722228 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722230 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722233 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722236 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722238 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722241 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722244 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722246 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722249 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722251 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722254 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722257 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722262 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722264 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722267 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722269 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722272 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722275 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722277 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 03:41:09.810189 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722280 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722282 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722285 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722287 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722290 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722293 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722295 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722298 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722300 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722302 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722305 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722308 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722310 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722313 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722316 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722318 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722321 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722324 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722327 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 03:41:09.815480 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722330 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722333 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722337 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722339 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722342 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722344 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722348 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722351 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722353 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722356 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722360 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722363 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722366 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722370 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722374 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722377 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722380 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722382 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722386 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 03:41:09.818987 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722389 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722392 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722394 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722397 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722399 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722402 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722405 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722407 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722410 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722412 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722415 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722417 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722420 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722423 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722425 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722428 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722430 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722432 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722435 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722438 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 03:41:09.824122 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722442 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722446 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722449 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722452 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722455 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722457 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722460 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722464 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722466 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722469 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722471 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722474 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722476 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722479 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722497 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722500 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.722503 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722580 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722589 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722597 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722603 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 03:41:09.830300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722610 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722613 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722617 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722622 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722625 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722628 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722631 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722635 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722638 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722641 2566 flags.go:64] FLAG: --cgroup-root="" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722646 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722649 2566 flags.go:64] FLAG: --client-ca-file="" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722652 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722655 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722660 2566 flags.go:64] FLAG: --cluster-domain="" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722663 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722666 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722669 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722674 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722678 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722681 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722684 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722693 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722696 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 13 03:41:09.834426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722699 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722702 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722705 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722708 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722712 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722715 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722718 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722721 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722724 2566 flags.go:64] FLAG: --enable-server="true" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722729 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722733 2566 flags.go:64] FLAG: --event-burst="100" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722736 2566 flags.go:64] FLAG: --event-qps="50" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722739 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722741 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722744 2566 flags.go:64] FLAG: --eviction-hard="" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722748 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722751 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722754 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722758 2566 flags.go:64] FLAG: --eviction-soft="" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722761 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722764 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722767 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722770 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722772 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722775 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 03:41:09.839531 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722778 2566 flags.go:64] FLAG: --feature-gates="" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722783 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722786 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722789 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722792 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722795 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722798 2566 flags.go:64] FLAG: --help="false" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722801 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-160.ec2.internal" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722804 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722807 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722810 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722814 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722817 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722820 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722823 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722826 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722829 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722832 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722836 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722838 2566 flags.go:64] FLAG: --kube-reserved="" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722841 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722844 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722847 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722850 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 03:41:09.988472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722853 2566 flags.go:64] FLAG: --lock-file="" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722857 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722860 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722862 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722868 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722870 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722873 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722876 2566 flags.go:64] FLAG: --logging-format="text" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722879 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722884 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722888 2566 flags.go:64] FLAG: --manifest-url="" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722890 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722895 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722898 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722902 2566 flags.go:64] FLAG: --max-pods="110" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722904 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722907 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722910 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722913 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722916 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722919 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722922 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722928 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722931 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722934 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 03:41:10.020971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722937 2566 flags.go:64] FLAG: --pod-cidr="" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722941 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722946 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722949 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722952 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722955 2566 flags.go:64] FLAG: --port="10250" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722958 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722961 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c4ae8d05a3e1fc89" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722964 2566 flags.go:64] FLAG: --qos-reserved="" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722969 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722972 2566 flags.go:64] FLAG: --register-node="true" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722975 2566 flags.go:64] FLAG: --register-with-taints="" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722978 2566 flags.go:64] FLAG: --registry-burst="10" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722981 2566 flags.go:64] FLAG: --registry-qps="5" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722984 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722987 2566 flags.go:64] FLAG: --reserved-memory="" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722992 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722995 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.722998 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723001 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723004 2566 flags.go:64] FLAG: --runonce="false" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723006 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723009 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723012 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723015 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 03:41:10.022496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723018 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723021 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723024 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723027 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723030 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723033 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723035 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723038 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723041 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723044 2566 flags.go:64] FLAG: --system-cgroups="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723047 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723052 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723055 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723058 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723062 2566 flags.go:64] FLAG: --tls-min-version="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723064 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723069 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723072 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723074 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723077 2566 flags.go:64] FLAG: --v="2" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723081 2566 flags.go:64] FLAG: --version="false" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723085 2566 flags.go:64] FLAG: --vmodule="" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723088 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.723093 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723222 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 03:41:10.036251 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723226 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723229 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723232 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723235 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723238 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723241 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723244 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723247 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723250 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723253 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723256 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723259 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723261 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723264 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723267 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723270 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723272 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723275 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723278 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723280 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 03:41:10.037859 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723283 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723285 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723288 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723292 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723294 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723297 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723299 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723302 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723304 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723307 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723311 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723313 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723316 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723318 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723322 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723326 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723329 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723332 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723335 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723338 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 03:41:10.038894 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723340 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723343 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723346 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723349 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723352 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723355 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723357 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723360 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723362 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723365 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723368 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723370 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723373 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723375 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723378 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723381 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723414 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723419 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723423 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 03:41:10.039965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723427 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723430 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723433 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723435 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723438 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723441 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723443 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723446 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723448 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723452 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723456 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723459 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723462 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723465 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723468 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723470 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723473 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723475 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723478 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723498 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 03:41:10.040995 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723502 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723506 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723508 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723511 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723513 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723516 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723519 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723523 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723525 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723528 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723533 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723536 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723539 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723541 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723544 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723547 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723549 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723552 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 03:41:10.042033 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.723555 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.724238 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.730996 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.731010 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.731861 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.731870 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731924 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731929 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731933 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731936 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731939 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731942 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731944 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731947 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731950 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 03:41:10.043067 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731952 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731955 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731957 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731960 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731966 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731969 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731971 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731974 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731976 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731979 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731982 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731985 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731988 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731990 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731994 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.731997 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732001 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732004 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732007 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 03:41:10.044077 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732010 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732013 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732016 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732018 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732021 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732023 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732026 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732028 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732031 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732034 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732037 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732041 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732044 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732046 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732049 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732051 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732054 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732058 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732061 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732063 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 03:41:10.045088 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732066 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732069 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732071 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732074 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732076 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732079 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732081 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732084 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732087 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732090 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732092 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732095 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732097 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732099 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732102 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732105 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732107 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732109 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732112 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732115 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 03:41:10.046160 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732118 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732120 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732123 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732125 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732128 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732130 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732133 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732135 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732138 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732142 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732144 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732146 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732149 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732151 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732157 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732159 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732162 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732164 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732167 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732169 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 03:41:10.047196 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732172 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732175 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732179 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732182 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732185 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732188 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732191 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732193 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732196 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732198 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732201 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.732206 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732339 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732344 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732348 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 03:41:10.048229 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732350 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732353 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732356 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732359 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732361 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732364 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732368 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732371 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732374 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732376 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732378 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732381 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732384 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732387 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732390 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732392 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732395 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732397 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732400 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732403 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 03:41:10.049212 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732405 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732408 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732410 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732413 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732415 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732418 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732420 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732423 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732425 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732428 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732430 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732433 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732435 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732438 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732440 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732443 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732445 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732448 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732451 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732454 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732456 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 03:41:10.050290 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732459 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732462 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732466 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732470 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732473 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732476 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732479 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732498 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732502 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732505 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732507 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732511 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732514 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732517 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732520 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732522 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732525 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732527 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732530 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 03:41:10.051314 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732532 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732535 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732537 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732539 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732542 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732544 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732547 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732549 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732552 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732554 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732559 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732563 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732566 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732569 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732572 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732574 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732580 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732584 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732587 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732589 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 03:41:10.152015 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732592 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732594 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732597 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732599 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732602 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732605 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732607 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732610 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732612 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732615 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732617 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732620 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732622 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732625 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732627 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 03:41:10.153021 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:09.732630 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.732634 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.732729 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.734914 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.736412 2566 server.go:1019] "Starting client certificate rotation" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.736515 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.736544 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.739019 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.744901 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.760755 2566 log.go:25] "Validated CRI v1 runtime API" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.762993 2566 log.go:25] "Validated CRI v1 image API" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.764438 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 03:41:10.154015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.766897 2566 fs.go:135] Filesystem UUIDs: map[23837255-67b2-4d65-9aaa-dab7660ef8af:/dev/nvme0n1p3 6df8b92d-0c76-4b0a-8220-56749689b17a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 13 03:41:10.154589 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.766914 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 03:41:10.154589 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.768915 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.772056 2566 manager.go:216] Machine: {Timestamp:2026-07-13 03:41:09.770708769 +0000 UTC m=+0.381735557 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121528 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f780e28977255f822e2cf640a505c SystemUUID:ec2f780e-2897-7255-f822-e2cf640a505c BootID:fb0b98c5-c7e5-4c3c-abca-4a814ebaa739 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0c:a4:e9:7b:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0c:a4:e9:7b:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:c5:18:b1:d3:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.772163 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.772235 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.774974 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.774996 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.775749 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.775758 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.775766 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.775778 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.777553 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.780818 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.780931 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.780958 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.780971 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.780989 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.781002 2566 kubelet.go:398] "Adding apiserver pod source" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.781011 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 03:41:10.159588 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.781336 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.781354 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.783755 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786160 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786187 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786339 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786351 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786356 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786362 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786370 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.786375 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.787071 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.787077 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.787083 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.787089 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.787104 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.787112 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.788790 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.788799 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.791747 2566 server.go:1268] "Started kubelet" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.791824 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.795048 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.795124 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.796733 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.799431 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.799540 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.800253 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.800969 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.801832 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.801993 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c1bc6517c18cad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-13 03:41:09.791706285 +0000 UTC m=+0.402733073,LastTimestamp:2026-07-13 03:41:09.791706285 +0000 UTC m=+0.402733073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.808637 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.808654 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.808755 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809025 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqmxj" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809389 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809404 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809441 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809604 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809614 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809657 2566 factory.go:55] Registering systemd factory Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809670 2566 factory.go:223] Registration of the systemd container factory successfully Jul 13 03:41:10.160619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809848 2566 factory.go:153] Registering CRI-O factory Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809862 2566 factory.go:223] Registration of the crio container factory successfully Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809916 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809939 2566 factory.go:103] Registering Raw factory Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.809953 2566 manager.go:1196] Started watching for new ooms in manager Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.812268 2566 manager.go:349] Starting recovery of all containers Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.817721 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.817745 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.818498 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqmxj" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.824368 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.825375 2566 manager.go:354] Recovery completed Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.831076 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833050 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833074 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833083 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833725 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833736 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833746 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.833754 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.834541 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.834567 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.834577 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.834803 2566 policy_none.go:49] "None policy: Start" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.834819 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.834832 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.835249 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c1bc651a388f16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-13 03:41:09.833060118 +0000 UTC m=+0.444086906,LastTimestamp:2026-07-13 03:41:09.833060118 +0000 UTC m=+0.444086906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.835811 2566 policy_none.go:47] "Start" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.870077 2566 manager.go:337] "Starting Device Plugin manager" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.870115 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.870126 2566 server.go:87] "Starting device plugin registration server" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.870351 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.870361 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.870535 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.870987 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.871036 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.871130 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.871145 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.921990 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.922032 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.922059 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 03:41:10.173618 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.922096 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.923892 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.970871 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.971838 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.971876 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.971893 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.971917 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:09.983226 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:09.983247 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-160.ec2.internal\": node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.003952 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.022674 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"] Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.022729 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.023572 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.023593 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.023602 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.024778 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.025112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.025134 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.025843 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.025859 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.025869 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.026439 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.026455 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.026463 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.027600 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.027622 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.028385 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.028401 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 03:41:10.175677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.028410 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 13 03:41:10.277246 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.210828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8997424ab9ede1966bb41bf6bb742766-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"8997424ab9ede1966bb41bf6bb742766\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.277246 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.211004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/035474fd828a5b10f3b6c24a85abc6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"035474fd828a5b10f3b6c24a85abc6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.277246 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.211028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035474fd828a5b10f3b6c24a85abc6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"035474fd828a5b10f3b6c24a85abc6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.399830 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.311341 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8997424ab9ede1966bb41bf6bb742766-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"8997424ab9ede1966bb41bf6bb742766\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.399830 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.311368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/035474fd828a5b10f3b6c24a85abc6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"035474fd828a5b10f3b6c24a85abc6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.399830 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.311384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035474fd828a5b10f3b6c24a85abc6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"035474fd828a5b10f3b6c24a85abc6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.399830 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.311423 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035474fd828a5b10f3b6c24a85abc6d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"035474fd828a5b10f3b6c24a85abc6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.399830 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.311467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8997424ab9ede1966bb41bf6bb742766-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"8997424ab9ede1966bb41bf6bb742766\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.399830 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.311505 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/035474fd828a5b10f3b6c24a85abc6d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"035474fd828a5b10f3b6c24a85abc6d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.515356 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.487625 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.649078 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.588418 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.775409 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.689297 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 13 03:41:10.775409 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.735246 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 03:41:10.775409 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.735428 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 03:41:10.775409 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.769901 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 03:41:10.783092 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.781590 2566 apiserver.go:52] "Watching apiserver" Jul 13 03:41:10.792389 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.791084 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 03:41:10.792389 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.791533 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-mh5nh","openshift-dns/node-resolver-sb8vh","openshift-multus/multus-tlszd","openshift-network-operator/iptables-alerter-q5kr5","openshift-image-registry/node-ca-twp2d","openshift-multus/multus-additional-cni-plugins-fhf7m","openshift-multus/network-metrics-daemon-4jllf","openshift-network-diagnostics/network-check-target-x6ssv","openshift-ovn-kubernetes/ovnkube-node-4f6ms","kube-system/global-pull-secret-syncer-rxgxc","kube-system/konnectivity-agent-8cmxg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht"] Jul 13 03:41:10.795340 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.793003 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.795340 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.794227 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.795655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.796329 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lcgp2\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.796495 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.796764 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.797344 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.797692 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6t8dz\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.797847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.798448 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.798721 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.799205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vnxtb\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.799276 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.799747 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.800151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.800978 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.801700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.801773 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.801884 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.802107 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.802143 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flmxd\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.802624 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.802773 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.802785 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6gglj\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.802846 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.803081 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.803157 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.804335 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.805800 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.805861 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.806383 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.806752 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.806896 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.806881 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.911321 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.807014 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.807078 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2c55k\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.807089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.807595 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.808551 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.808742 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.808806 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.809473 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.809496 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.809764 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4hpn8\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.810061 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.811009 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.811012 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.811056 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.811108 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vlw2c\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.812424 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.812539 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xrngf\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.812884 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.813025 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7nw\" (UniqueName: \"kubernetes.io/projected/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-kube-api-access-pt7nw\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-system-cni-dir\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkdhw\" (UniqueName: \"kubernetes.io/projected/2e620f9b-f433-43f0-8bc5-d575fd26ee00-kube-api-access-kkdhw\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-node-log\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-host-slash\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn524\" (UniqueName: \"kubernetes.io/projected/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-kube-api-access-fn524\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.913138 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-host\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cnibin\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814732 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-netns\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-var-lib-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814816 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-os-release\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-os-release\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-socket-dir-parent\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-multus-certs\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-cni-bin\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.814993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovnkube-script-lib\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysconfig\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-lib-modules\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-var-lib-kubelet\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.914930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5xt\" (UniqueName: \"kubernetes.io/projected/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-kube-api-access-th5xt\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-kubelet\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-systemd\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-cnibin\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-etc-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-ovn\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9jm\" (UniqueName: \"kubernetes.io/projected/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-kube-api-access-5w9jm\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815214 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-socket-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rklv\" (UniqueName: \"kubernetes.io/projected/43ba24d6-dda5-4324-abec-2171a697a755-kube-api-access-8rklv\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815274 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-tmp\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovn-node-metrics-cert\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-registration-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-k8s-cni-cncf-io\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-cni-multus\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-systemd\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.915923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-cni-netd\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-modprobe-d\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysctl-conf\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-system-cni-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-kubelet\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-daemon-config\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-etc-kubernetes\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-kubelet-config\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-kubernetes\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-conf-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f169a86-02b5-4edb-82fe-991e59579698-tmp-dir\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgwp9\" (UniqueName: \"kubernetes.io/projected/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-kube-api-access-wgwp9\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-tuned\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e620f9b-f433-43f0-8bc5-d575fd26ee00-cni-binary-copy\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-cni-bin\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-run-netns\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-env-overrides\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.917947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-dbus\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-serviceca\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.815993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-host\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-cni-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-systemd-units\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-log-socket\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f169a86-02b5-4edb-82fe-991e59579698-hosts-file\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-sys\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-iptables-alerter-script\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816218 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skjsg\" (UniqueName: \"kubernetes.io/projected/b9ebce7a-2727-48af-ad6a-17e26c8eada0-kube-api-access-skjsg\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-run\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovnkube-config\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.919304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-device-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-sys-fs\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-hostroot\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-slash\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtbmb\" (UniqueName: \"kubernetes.io/projected/1f169a86-02b5-4edb-82fe-991e59579698-kube-api-access-qtbmb\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7a47283-9c9e-4392-9726-4c554c3a2ba8-agent-certs\") pod \"konnectivity-agent-8cmxg\" (UID: \"f7a47283-9c9e-4392-9726-4c554c3a2ba8\") " pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7a47283-9c9e-4392-9726-4c554c3a2ba8-konnectivity-ca\") pod \"konnectivity-agent-8cmxg\" (UID: \"f7a47283-9c9e-4392-9726-4c554c3a2ba8\") " pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816433 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysctl-d\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.816447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-etc-selinux\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.819465 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.819531 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.820495 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"] Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.825363 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.826179 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 03:36:10 +0000 UTC" deadline="2027-12-13 18:16:22.694304601 +0000 UTC" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.826244 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12446h35m11.868064627s" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.833563 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.833758 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"] Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.843106 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zphhn" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.852003 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zphhn" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.909733 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 03:41:10.921940 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovnkube-config\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-device-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-sys-fs\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-hostroot\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917217 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-sys-fs\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917232 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-hostroot\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-slash\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917294 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-device-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtbmb\" (UniqueName: \"kubernetes.io/projected/1f169a86-02b5-4edb-82fe-991e59579698-kube-api-access-qtbmb\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917340 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-slash\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917360 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7a47283-9c9e-4392-9726-4c554c3a2ba8-agent-certs\") pod \"konnectivity-agent-8cmxg\" (UID: \"f7a47283-9c9e-4392-9726-4c554c3a2ba8\") " pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7a47283-9c9e-4392-9726-4c554c3a2ba8-konnectivity-ca\") pod \"konnectivity-agent-8cmxg\" (UID: \"f7a47283-9c9e-4392-9726-4c554c3a2ba8\") " pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysctl-d\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917443 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-etc-selinux\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.923514 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7nw\" (UniqueName: \"kubernetes.io/projected/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-kube-api-access-pt7nw\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-system-cni-dir\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkdhw\" (UniqueName: \"kubernetes.io/projected/2e620f9b-f433-43f0-8bc5-d575fd26ee00-kube-api-access-kkdhw\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-node-log\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917589 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-system-cni-dir\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917593 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-etc-selinux\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917598 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917637 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-node-log\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917639 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-host-slash\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917650 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn524\" (UniqueName: \"kubernetes.io/projected/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-kube-api-access-fn524\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-host\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917696 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-host-slash\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cnibin\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917736 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-host\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917750 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cnibin\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-netns\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.925365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-var-lib-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917781 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-netns\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917809 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-var-lib-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917821 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysctl-d\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917839 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917874 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-os-release\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917878 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-os-release\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917940 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-os-release\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-socket-dir-parent\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-multus-certs\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917988 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-os-release\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.917993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-cni-bin\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovnkube-script-lib\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.926428 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918037 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-multus-certs\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918042 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysconfig\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-lib-modules\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918087 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-socket-dir-parent\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918088 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-var-lib-kubelet\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5xt\" (UniqueName: \"kubernetes.io/projected/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-kube-api-access-th5xt\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-cni-bin\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-kubelet\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-systemd\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918187 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-lib-modules\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-cnibin\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918201 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-var-lib-kubelet\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918215 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysconfig\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918231 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-kubelet\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-etc-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918263 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-etc-openvswitch\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918268 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-systemd\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-ovn\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.927618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-ovn\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918301 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9jm\" (UniqueName: \"kubernetes.io/projected/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-kube-api-access-5w9jm\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918320 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-cnibin\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-socket-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rklv\" (UniqueName: \"kubernetes.io/projected/43ba24d6-dda5-4324-abec-2171a697a755-kube-api-access-8rklv\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918413 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-tmp\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovn-node-metrics-cert\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-registration-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918472 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-socket-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918528 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43ba24d6-dda5-4324-abec-2171a697a755-registration-dir\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-k8s-cni-cncf-io\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-cni-multus\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-systemd\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-cni-netd\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-modprobe-d\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918745 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysctl-conf\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.928723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918774 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-run-k8s-cni-cncf-io\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-system-cni-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918819 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-run-systemd\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918851 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-kubelet\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918857 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-modprobe-d\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918863 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-system-cni-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-daemon-config\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-etc-kubernetes\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-kubelet-config\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-kubernetes\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-conf-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919015 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-sysctl-conf\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919028 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f169a86-02b5-4edb-82fe-991e59579698-tmp-dir\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-kubernetes\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-kubelet-config\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.918746 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-cni-multus\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919135 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-conf-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgwp9\" (UniqueName: \"kubernetes.io/projected/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-kube-api-access-wgwp9\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:10.929893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919175 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-cni-netd\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-tuned\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e620f9b-f433-43f0-8bc5-d575fd26ee00-cni-binary-copy\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919552 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-etc-kubernetes\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-cni-bin\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-run-netns\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919697 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-kubelet\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919743 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-host-run-netns\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-env-overrides\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919805 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-host-var-lib-cni-bin\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919837 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-dbus\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.919984 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.919989 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-dbus\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.920085 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:41:11.420045464 +0000 UTC m=+2.031072258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920104 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-serviceca\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-host\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.931001 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920158 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-cni-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-host\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920203 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-systemd-units\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-log-socket\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920292 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-cni-dir\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-log-socket\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920367 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-systemd-units\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920404 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9ebce7a-2727-48af-ad6a-17e26c8eada0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f169a86-02b5-4edb-82fe-991e59579698-hosts-file\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920529 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-sys\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920560 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f169a86-02b5-4edb-82fe-991e59579698-hosts-file\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-iptables-alerter-script\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920598 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skjsg\" (UniqueName: \"kubernetes.io/projected/b9ebce7a-2727-48af-ad6a-17e26c8eada0-kube-api-access-skjsg\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.920652 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:10.932147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920656 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-run\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.920707 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:11.420690106 +0000 UTC m=+2.031716882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-run\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.920631 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-sys\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.921407 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.922371 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.923091 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f169a86-02b5-4edb-82fe-991e59579698-tmp-dir\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.923467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e620f9b-f433-43f0-8bc5-d575fd26ee00-multus-daemon-config\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.923861 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-iptables-alerter-script\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.924025 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-serviceca\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.924041 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.924105 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e620f9b-f433-43f0-8bc5-d575fd26ee00-cni-binary-copy\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.924370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-env-overrides\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.924621 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovnkube-config\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.924671 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7a47283-9c9e-4392-9726-4c554c3a2ba8-konnectivity-ca\") pod \"konnectivity-agent-8cmxg\" (UID: \"f7a47283-9c9e-4392-9726-4c554c3a2ba8\") " pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.925098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovnkube-script-lib\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.925479 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9ebce7a-2727-48af-ad6a-17e26c8eada0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.933845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.926817 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-ovn-node-metrics-cert\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.927828 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.927851 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.927866 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.927937 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:11.427919418 +0000 UTC m=+2.038946213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.928468 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.932338 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgwp9\" (UniqueName: \"kubernetes.io/projected/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-kube-api-access-wgwp9\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.934047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skjsg\" (UniqueName: \"kubernetes.io/projected/b9ebce7a-2727-48af-ad6a-17e26c8eada0-kube-api-access-skjsg\") pod \"multus-additional-cni-plugins-fhf7m\" (UID: \"b9ebce7a-2727-48af-ad6a-17e26c8eada0\") " pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.936196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7nw\" (UniqueName: \"kubernetes.io/projected/43fd49e6-f97a-4eb3-91d0-8ed2a0e04441-kube-api-access-pt7nw\") pod \"node-ca-twp2d\" (UID: \"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441\") " pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.938280 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:10.938321 2566 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:10.939547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:10.938505 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.000258 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-tmp\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.000515 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7a47283-9c9e-4392-9726-4c554c3a2ba8-agent-certs\") pod \"konnectivity-agent-8cmxg\" (UID: \"f7a47283-9c9e-4392-9726-4c554c3a2ba8\") " pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.000543 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rklv\" (UniqueName: \"kubernetes.io/projected/43ba24d6-dda5-4324-abec-2171a697a755-kube-api-access-8rklv\") pod \"aws-ebs-csi-driver-node-9zlht\" (UID: \"43ba24d6-dda5-4324-abec-2171a697a755\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.000734 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-etc-tuned\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.001094 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkdhw\" (UniqueName: \"kubernetes.io/projected/2e620f9b-f433-43f0-8bc5-d575fd26ee00-kube-api-access-kkdhw\") pod \"multus-tlszd\" (UID: \"2e620f9b-f433-43f0-8bc5-d575fd26ee00\") " pod="openshift-multus/multus-tlszd" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.001099 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtbmb\" (UniqueName: \"kubernetes.io/projected/1f169a86-02b5-4edb-82fe-991e59579698-kube-api-access-qtbmb\") pod \"node-resolver-sb8vh\" (UID: \"1f169a86-02b5-4edb-82fe-991e59579698\") " pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.001122 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn524\" (UniqueName: \"kubernetes.io/projected/e975e4d3-bcc3-43ab-ad88-be17a077ebbd-kube-api-access-fn524\") pod \"iptables-alerter-q5kr5\" (UID: \"e975e4d3-bcc3-43ab-ad88-be17a077ebbd\") " pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.002044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9jm\" (UniqueName: \"kubernetes.io/projected/969cc0b1-f0d3-48e9-9c93-3100c9d37e1d-kube-api-access-5w9jm\") pod \"ovnkube-node-4f6ms\" (UID: \"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.004102 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5xt\" (UniqueName: \"kubernetes.io/projected/c8b64121-79b7-4a6a-9e6f-8f0de7386c55-kube-api-access-th5xt\") pod \"tuned-mh5nh\" (UID: \"c8b64121-79b7-4a6a-9e6f-8f0de7386c55\") " pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.015399 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.016043 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.026046 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.026081 2566 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.026256 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.039344 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.060304 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sb8vh" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.079286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tlszd" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.085396 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-twp2d" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.106371 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" Jul 13 03:41:11.118339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.118263 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:11.786621 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.786592 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.786831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.786871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.786891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.786987 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787005 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787023 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787036 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787061 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:41:12.78702482 +0000 UTC m=+3.398051615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787101 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:12.7870857 +0000 UTC m=+3.398112477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787036 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:11.787903 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.787169 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:12.787152901 +0000 UTC m=+3.398179679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:11.789049 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.789029 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 03:41:11.809496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.809459 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" Jul 13 03:41:11.815803 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.815785 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q5kr5" Jul 13 03:41:11.854750 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.854706 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 03:36:11 +0000 UTC" deadline="2028-04-28 05:44:25.778707906 +0000 UTC" Jul 13 03:41:11.854750 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.854754 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15722h3m13.923974088s" Jul 13 03:41:11.885015 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.884981 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 03:41:11.922898 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.922829 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:11.923037 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:11.922962 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:11.945849 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.945813 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ebce7a_2727_48af_ad6a_17e26c8eada0.slice/crio-b356c45383503ad9333e9e659e7ada9905edd5870527f5c3b50f8ad1516e6698 WatchSource:0}: Error finding container b356c45383503ad9333e9e659e7ada9905edd5870527f5c3b50f8ad1516e6698: Status 404 returned error can't find the container with id b356c45383503ad9333e9e659e7ada9905edd5870527f5c3b50f8ad1516e6698 Jul 13 03:41:11.946329 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.946305 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8997424ab9ede1966bb41bf6bb742766.slice/crio-ea7cc2761a9fb21e9646a90d001680e56a0543fb116b82b4271d7725037bd557 WatchSource:0}: Error finding container ea7cc2761a9fb21e9646a90d001680e56a0543fb116b82b4271d7725037bd557: Status 404 returned error can't find the container with id ea7cc2761a9fb21e9646a90d001680e56a0543fb116b82b4271d7725037bd557 Jul 13 03:41:11.947093 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.947069 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035474fd828a5b10f3b6c24a85abc6d2.slice/crio-52608998f92ad59be291bd8075e05880283a92e8c8158376e6e5890c7299e450 WatchSource:0}: Error finding container 52608998f92ad59be291bd8075e05880283a92e8c8158376e6e5890c7299e450: Status 404 returned error can't find the container with id 52608998f92ad59be291bd8075e05880283a92e8c8158376e6e5890c7299e450 Jul 13 03:41:11.947809 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.947786 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b64121_79b7_4a6a_9e6f_8f0de7386c55.slice/crio-c95ca4a065e0987a7503c9c7b5e39f13bec823c78f1a2d8fb9e3036648ef563b WatchSource:0}: Error finding container c95ca4a065e0987a7503c9c7b5e39f13bec823c78f1a2d8fb9e3036648ef563b: Status 404 returned error can't find the container with id c95ca4a065e0987a7503c9c7b5e39f13bec823c78f1a2d8fb9e3036648ef563b Jul 13 03:41:11.950631 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.950610 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e620f9b_f433_43f0_8bc5_d575fd26ee00.slice/crio-aebe6bcdaf1323b7ba118a7a86700b7324aea914b8eb24d9fd0cbc2a0ed40456 WatchSource:0}: Error finding container aebe6bcdaf1323b7ba118a7a86700b7324aea914b8eb24d9fd0cbc2a0ed40456: Status 404 returned error can't find the container with id aebe6bcdaf1323b7ba118a7a86700b7324aea914b8eb24d9fd0cbc2a0ed40456 Jul 13 03:41:11.954555 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:11.954387 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:41:11.958938 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.958908 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fd49e6_f97a_4eb3_91d0_8ed2a0e04441.slice/crio-3a5fa0e31c4131a65414accb4a5823103a92d422c540829027bb6fa17a1f2639 WatchSource:0}: Error finding container 3a5fa0e31c4131a65414accb4a5823103a92d422c540829027bb6fa17a1f2639: Status 404 returned error can't find the container with id 3a5fa0e31c4131a65414accb4a5823103a92d422c540829027bb6fa17a1f2639 Jul 13 03:41:11.978102 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:11.978080 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f169a86_02b5_4edb_82fe_991e59579698.slice/crio-951a051bece6500af40be1177227d8b75c109bb127a220f8a1bd41bf10445010 WatchSource:0}: Error finding container 951a051bece6500af40be1177227d8b75c109bb127a220f8a1bd41bf10445010: Status 404 returned error can't find the container with id 951a051bece6500af40be1177227d8b75c109bb127a220f8a1bd41bf10445010 Jul 13 03:41:12.127723 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:12.127696 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969cc0b1_f0d3_48e9_9c93_3100c9d37e1d.slice/crio-a6bc93e38c4c604276fc448faa539a53450b40d7551429fd2f550b2f0d5133ee WatchSource:0}: Error finding container a6bc93e38c4c604276fc448faa539a53450b40d7551429fd2f550b2f0d5133ee: Status 404 returned error can't find the container with id a6bc93e38c4c604276fc448faa539a53450b40d7551429fd2f550b2f0d5133ee Jul 13 03:41:12.179300 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:12.179272 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ba24d6_dda5_4324_abec_2171a697a755.slice/crio-e3375ce20da88d4e1b4f049e1a0bcdd6695ab2856a42bb5be3c0f6dc2c786590 WatchSource:0}: Error finding container e3375ce20da88d4e1b4f049e1a0bcdd6695ab2856a42bb5be3c0f6dc2c786590: Status 404 returned error can't find the container with id e3375ce20da88d4e1b4f049e1a0bcdd6695ab2856a42bb5be3c0f6dc2c786590 Jul 13 03:41:12.193038 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:12.193015 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a47283_9c9e_4392_9726_4c554c3a2ba8.slice/crio-b0f271978cd59273b638ee5005cd3bba9b87143312e155cd435b3381621bee3c WatchSource:0}: Error finding container b0f271978cd59273b638ee5005cd3bba9b87143312e155cd435b3381621bee3c: Status 404 returned error can't find the container with id b0f271978cd59273b638ee5005cd3bba9b87143312e155cd435b3381621bee3c Jul 13 03:41:12.229601 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:12.229579 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode975e4d3_bcc3_43ab_ad88_be17a077ebbd.slice/crio-ad87fd170b664eb07657852b7d70abfaf094eaa348575620a4a16f0b749c78e1 WatchSource:0}: Error finding container ad87fd170b664eb07657852b7d70abfaf094eaa348575620a4a16f0b749c78e1: Status 404 returned error can't find the container with id ad87fd170b664eb07657852b7d70abfaf094eaa348575620a4a16f0b749c78e1 Jul 13 03:41:12.798009 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.797966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.798025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.798083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.798250 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.798317 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:14.798296336 +0000 UTC m=+5.409323121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.798479 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.798498 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.798512 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.798574 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:14.798559235 +0000 UTC m=+5.409586026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.799049 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:12.799697 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.799101 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:41:14.799086314 +0000 UTC m=+5.410113106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:12.855917 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.855848 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 03:36:11 +0000 UTC" deadline="2028-04-27 12:16:49.879634954 +0000 UTC" Jul 13 03:41:12.855917 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.855914 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15704h35m37.023724915s" Jul 13 03:41:12.923610 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.923579 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:12.923801 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.923715 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:12.924136 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.923979 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:12.924136 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:12.924068 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:12.942394 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.942292 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" event={"ID":"c8b64121-79b7-4a6a-9e6f-8f0de7386c55","Type":"ContainerStarted","Data":"c95ca4a065e0987a7503c9c7b5e39f13bec823c78f1a2d8fb9e3036648ef563b"} Jul 13 03:41:12.945971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.945872 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerStarted","Data":"b356c45383503ad9333e9e659e7ada9905edd5870527f5c3b50f8ad1516e6698"} Jul 13 03:41:12.966363 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.966305 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"035474fd828a5b10f3b6c24a85abc6d2","Type":"ContainerStarted","Data":"52608998f92ad59be291bd8075e05880283a92e8c8158376e6e5890c7299e450"} Jul 13 03:41:12.981738 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:12.981666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q5kr5" event={"ID":"e975e4d3-bcc3-43ab-ad88-be17a077ebbd","Type":"ContainerStarted","Data":"ad87fd170b664eb07657852b7d70abfaf094eaa348575620a4a16f0b749c78e1"} Jul 13 03:41:13.008455 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.008412 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sb8vh" event={"ID":"1f169a86-02b5-4edb-82fe-991e59579698","Type":"ContainerStarted","Data":"951a051bece6500af40be1177227d8b75c109bb127a220f8a1bd41bf10445010"} Jul 13 03:41:13.014673 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.014641 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tlszd" event={"ID":"2e620f9b-f433-43f0-8bc5-d575fd26ee00","Type":"ContainerStarted","Data":"aebe6bcdaf1323b7ba118a7a86700b7324aea914b8eb24d9fd0cbc2a0ed40456"} Jul 13 03:41:13.023986 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.023938 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" event={"ID":"8997424ab9ede1966bb41bf6bb742766","Type":"ContainerStarted","Data":"ea7cc2761a9fb21e9646a90d001680e56a0543fb116b82b4271d7725037bd557"} Jul 13 03:41:13.038647 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.038617 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8cmxg" event={"ID":"f7a47283-9c9e-4392-9726-4c554c3a2ba8","Type":"ContainerStarted","Data":"b0f271978cd59273b638ee5005cd3bba9b87143312e155cd435b3381621bee3c"} Jul 13 03:41:13.045845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.045812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" event={"ID":"43ba24d6-dda5-4324-abec-2171a697a755","Type":"ContainerStarted","Data":"e3375ce20da88d4e1b4f049e1a0bcdd6695ab2856a42bb5be3c0f6dc2c786590"} Jul 13 03:41:13.057130 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.057059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"a6bc93e38c4c604276fc448faa539a53450b40d7551429fd2f550b2f0d5133ee"} Jul 13 03:41:13.079638 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.079601 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-twp2d" event={"ID":"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441","Type":"ContainerStarted","Data":"3a5fa0e31c4131a65414accb4a5823103a92d422c540829027bb6fa17a1f2639"} Jul 13 03:41:13.925361 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:13.925328 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:13.925888 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:13.925541 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:14.822629 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:14.822522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:14.822629 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:14.822584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:14.822629 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:14.822615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:14.822946 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.822801 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:14.822946 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.822865 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:18.822845401 +0000 UTC m=+9.433872193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:14.823307 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.823286 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:14.823395 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.823348 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:41:18.823331133 +0000 UTC m=+9.434357928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:14.823459 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.823444 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:14.823459 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.823459 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:14.823609 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.823472 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:14.823609 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.823507 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:18.823495196 +0000 UTC m=+9.434521990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:14.922996 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:14.922959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:14.923187 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.923097 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:14.923187 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:14.923160 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:14.923302 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:14.923240 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:15.923967 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:15.923689 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:15.923967 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:15.923889 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:16.922845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:16.922805 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:16.923068 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:16.923029 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:16.923499 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:16.923443 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:16.923628 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:16.923612 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:17.923227 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:17.923190 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:17.923803 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:17.923322 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:18.859185 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:18.859010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:18.859185 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:18.859062 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:18.859185 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:18.859090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:18.859185 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859184 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859243 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:41:26.859228118 +0000 UTC m=+17.470254907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859312 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859341 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859355 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859407 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:26.859389638 +0000 UTC m=+17.470416431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859470 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:18.859536 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.859524 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:26.859511514 +0000 UTC m=+17.470538300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:18.923264 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:18.923229 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:18.923754 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.923366 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:18.923754 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:18.923229 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:18.923754 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:18.923538 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:19.923925 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:19.923890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:19.924466 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:19.924042 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:20.923356 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:20.922639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:20.923356 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:20.922836 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:20.923356 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:20.922639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:20.923356 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:20.923316 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:21.922880 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:21.922838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:21.923293 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:21.922977 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:22.922352 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:22.922294 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:22.922352 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:22.922299 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:22.922638 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:22.922424 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:22.922638 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:22.922573 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:23.923271 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:23.923230 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:23.923675 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:23.923392 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:24.923238 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:24.923206 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:24.923411 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:24.923207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:24.923411 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:24.923326 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:24.923816 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:24.923426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:25.923108 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:25.923012 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:25.923307 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:25.923169 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:26.918544 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:26.918107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:26.918544 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:26.918232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:26.918544 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:26.918288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:26.919117 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.918656 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:26.919117 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.918880 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:42.918857873 +0000 UTC m=+33.529884662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:26.919605 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.919585 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:26.919730 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.919645 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:41:42.919630733 +0000 UTC m=+33.530657523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:26.919860 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.919741 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:26.919860 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.919760 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:26.919860 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.919797 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:26.920015 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.919857 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:42.919843693 +0000 UTC m=+33.530870485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:26.922231 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:26.922207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:26.922347 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:26.922234 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:26.922347 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.922305 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:26.922439 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:26.922386 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:27.923044 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:27.923001 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:27.923514 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:27.923156 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:28.922719 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:28.922682 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:28.922907 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:28.922730 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:28.922907 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:28.922818 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:28.922995 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:28.922942 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:29.923684 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:29.923595 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:29.924147 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:29.923721 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:30.922323 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:30.922289 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:30.922323 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:30.922307 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:30.922576 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:30.922401 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:30.922576 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:30.922557 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:31.922372 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:31.922340 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:31.922859 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:31.922476 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:32.923222 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:32.923200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:32.923625 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:32.923216 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:32.923625 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:32.923330 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:32.923625 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:32.923468 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:33.129611 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.129456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" event={"ID":"c8b64121-79b7-4a6a-9e6f-8f0de7386c55","Type":"ContainerStarted","Data":"5ba564d86e3f768fd6456c164a708e7147dcad28114baaf7143d9ba85b7761a5"} Jul 13 03:41:33.130982 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.130958 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tlszd" event={"ID":"2e620f9b-f433-43f0-8bc5-d575fd26ee00","Type":"ContainerStarted","Data":"19833c662d567c89ff59551ad154005b053ea97ddc0186f39ce5733f7c91dd59"} Jul 13 03:41:33.132386 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.132364 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" event={"ID":"8997424ab9ede1966bb41bf6bb742766","Type":"ContainerStarted","Data":"4a257dd6151040a98aabafce6c4bfe991a4f59ab513b74b66554a85a03a017ba"} Jul 13 03:41:33.134896 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.134876 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:41:33.135218 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.135195 2566 generic.go:356] "Generic (PLEG): container finished" podID="969cc0b1-f0d3-48e9-9c93-3100c9d37e1d" containerID="6c79cfc20a70929bf12371526a11ea64f62be101289fc089eb85100b9ce7626f" exitCode=1 Jul 13 03:41:33.135293 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.135223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"86bd4fae88d871d43b15d6f4a5d110b83163d3c1a918c1ed7eeb7c97bcd91381"} Jul 13 03:41:33.135293 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.135288 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"90b3c851d1b35ffe383f037ec75d7aba0ca486f9da8694518c596e8516af172c"} Jul 13 03:41:33.135406 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.135327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"9e98ef3a465abc2b3b3f19263aa62db3500bb044b874e461e20adb857e16b776"} Jul 13 03:41:33.135406 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.135356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerDied","Data":"6c79cfc20a70929bf12371526a11ea64f62be101289fc089eb85100b9ce7626f"} Jul 13 03:41:33.135406 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.135384 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"ebb09b29cc3200451885840e5eafbfdd2f691bbe018ed68deeadf9c4a979179a"} Jul 13 03:41:33.148720 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.148030 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mh5nh" podStartSLOduration=2.60876755 podStartE2EDuration="23.148011239s" totalImagesPullingTime="20.539243689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:33.14754743 +0000 UTC m=+23.758574229" watchObservedRunningTime="2026-07-13 03:41:33.148011239 +0000 UTC m=+23.759038038" Jul 13 03:41:33.160594 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.160555 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" podStartSLOduration=22.160539164 podStartE2EDuration="22.160539164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:33.160174437 +0000 UTC m=+23.771201234" watchObservedRunningTime="2026-07-13 03:41:33.160539164 +0000 UTC m=+23.771565961" Jul 13 03:41:33.178684 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.178632 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tlszd" podStartSLOduration=2.593195131 podStartE2EDuration="23.178615011s" totalImagesPullingTime="20.58541988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:33.177908711 +0000 UTC m=+23.788935509" watchObservedRunningTime="2026-07-13 03:41:33.178615011 +0000 UTC m=+23.789641807" Jul 13 03:41:33.922576 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:33.922546 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:33.922751 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:33.922673 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:34.138668 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.138589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8cmxg" event={"ID":"f7a47283-9c9e-4392-9726-4c554c3a2ba8","Type":"ContainerStarted","Data":"4faee9e4a2b269ce121380f74a550dae45b6ddf11c16a60db11584f873eba109"} Jul 13 03:41:34.140064 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.140039 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" event={"ID":"43ba24d6-dda5-4324-abec-2171a697a755","Type":"ContainerStarted","Data":"35295716f977f2c0f2d4cdab7a480367e1fdadbf8d30f9da1d0c9733a1f0898e"} Jul 13 03:41:34.142776 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.142758 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:41:34.143289 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.143111 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"13cf34ff243f87112375f1babddcea468486159b759af9322fe7bc6433c93f40"} Jul 13 03:41:34.144439 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.144411 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-twp2d" event={"ID":"43fd49e6-f97a-4eb3-91d0-8ed2a0e04441","Type":"ContainerStarted","Data":"36ff7bc647f9079d848b890fa062aa0e00b7fa6bff79fcd97e6b76c205b181ef"} Jul 13 03:41:34.145821 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.145799 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9ebce7a-2727-48af-ad6a-17e26c8eada0" containerID="e28dabd828279a216bbe481dfb0a808b7aef5b5ec96a6df685ef76beeacc8c76" exitCode=0 Jul 13 03:41:34.145914 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.145855 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerDied","Data":"e28dabd828279a216bbe481dfb0a808b7aef5b5ec96a6df685ef76beeacc8c76"} Jul 13 03:41:34.150221 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.150198 2566 generic.go:356] "Generic (PLEG): container finished" podID="035474fd828a5b10f3b6c24a85abc6d2" containerID="9aa8492f428d1de2494763738174ee1ddcbdcc053720d2568e474881c3b80b21" exitCode=0 Jul 13 03:41:34.150315 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.150254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"035474fd828a5b10f3b6c24a85abc6d2","Type":"ContainerDied","Data":"9aa8492f428d1de2494763738174ee1ddcbdcc053720d2568e474881c3b80b21"} Jul 13 03:41:34.151787 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.151761 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q5kr5" event={"ID":"e975e4d3-bcc3-43ab-ad88-be17a077ebbd","Type":"ContainerStarted","Data":"5573d3511129c18508b48b41b4cbbb7a128a7c71be8f7a8009bc07dea6dbd179"} Jul 13 03:41:34.153239 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.153218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sb8vh" event={"ID":"1f169a86-02b5-4edb-82fe-991e59579698","Type":"ContainerStarted","Data":"5c477718a1b9843cb94dbfda12e74546e012fb95b755d82101e58c3fe370cf5e"} Jul 13 03:41:34.164678 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.164634 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8cmxg" podStartSLOduration=3.866702201 podStartE2EDuration="24.164621909s" totalImagesPullingTime="20.297919708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:34.152292955 +0000 UTC m=+24.763319764" watchObservedRunningTime="2026-07-13 03:41:34.164621909 +0000 UTC m=+24.775648706" Jul 13 03:41:34.176993 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.176954 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q5kr5" podStartSLOduration=2.918163375 podStartE2EDuration="23.176940836s" totalImagesPullingTime="20.258777461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:34.176927437 +0000 UTC m=+24.787954234" watchObservedRunningTime="2026-07-13 03:41:34.176940836 +0000 UTC m=+24.787967632" Jul 13 03:41:34.210824 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.210782 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-twp2d" podStartSLOduration=3.681159336 podStartE2EDuration="24.210768258s" totalImagesPullingTime="20.529608922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:34.188936817 +0000 UTC m=+24.799963614" watchObservedRunningTime="2026-07-13 03:41:34.210768258 +0000 UTC m=+24.821795052" Jul 13 03:41:34.225776 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.225732 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sb8vh" podStartSLOduration=3.714089639 podStartE2EDuration="24.225716534s" totalImagesPullingTime="20.511626895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:34.2253961 +0000 UTC m=+24.836422899" watchObservedRunningTime="2026-07-13 03:41:34.225716534 +0000 UTC m=+24.836743330" Jul 13 03:41:34.458410 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.458387 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 03:41:34.883674 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.883564 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T03:41:34.458404732Z","UUID":"901be0b2-f07e-44aa-b0fb-b94defeecc3d","Handler":null,"Name":"","Endpoint":""} Jul 13 03:41:34.885147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.885112 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 03:41:34.885266 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.885160 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 03:41:34.922392 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.922359 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:34.922565 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:34.922478 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:34.922565 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:34.922511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:34.922692 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:34.922617 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:35.158178 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:35.158081 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" event={"ID":"43ba24d6-dda5-4324-abec-2171a697a755","Type":"ContainerStarted","Data":"385276e52a96517f0954927d792b2fc040ff13e66dc6d5cc6c0215932b206b6e"} Jul 13 03:41:35.160125 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:35.160095 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"035474fd828a5b10f3b6c24a85abc6d2","Type":"ContainerStarted","Data":"2cfb5673d32edac28f8c001800b71b8736d897344b5402374b89c0f6b3368ece"} Jul 13 03:41:35.174463 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:35.174418 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" podStartSLOduration=24.174402021 podStartE2EDuration="24.174402021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:35.173906618 +0000 UTC m=+25.784933406" watchObservedRunningTime="2026-07-13 03:41:35.174402021 +0000 UTC m=+25.785428817" Jul 13 03:41:35.922650 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:35.922611 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:35.922819 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:35.922761 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:36.165060 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.165024 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" event={"ID":"43ba24d6-dda5-4324-abec-2171a697a755","Type":"ContainerStarted","Data":"6c1857c433b879ea9ef9041eed8a5de94ec468ddd85865ea1c61557cdad0dfde"} Jul 13 03:41:36.168792 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.168768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:41:36.169189 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.169159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"bcd4ce1564c10362b4bec9f57c1110124f9d4db65a1df32f865c07f1347fe0f7"} Jul 13 03:41:36.181370 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.181293 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9zlht" podStartSLOduration=3.17596842 podStartE2EDuration="26.181277974s" totalImagesPullingTime="23.005309554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:36.18126142 +0000 UTC m=+26.792288232" watchObservedRunningTime="2026-07-13 03:41:36.181277974 +0000 UTC m=+26.792304756" Jul 13 03:41:36.315897 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.315866 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:36.316397 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.316380 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:36.922727 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.922694 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:36.922891 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:36.922694 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:36.922891 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:36.922813 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:36.922891 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:36.922878 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:37.172494 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:37.172417 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:37.172943 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:37.172676 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8cmxg" Jul 13 03:41:37.922425 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:37.922385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:37.922594 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:37.922558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:38.923189 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:38.923012 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:38.923861 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:38.923041 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:38.923861 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:38.923273 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:38.923861 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:38.923327 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:39.178052 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:39.177973 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9ebce7a-2727-48af-ad6a-17e26c8eada0" containerID="837f3e8083847a95ed7603b92836a8bef90a969a634e7abeb6e0ddb2768a081b" exitCode=0 Jul 13 03:41:39.178228 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:39.178056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerDied","Data":"837f3e8083847a95ed7603b92836a8bef90a969a634e7abeb6e0ddb2768a081b"} Jul 13 03:41:39.181515 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:39.181498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:41:39.181848 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:39.181831 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"185bbb6fc27ac764741e0db0b5f8bbca026e924c522b2c8f72bd3fc02e65c363"} Jul 13 03:41:39.182271 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:39.182257 2566 scope.go:117] "RemoveContainer" containerID="6c79cfc20a70929bf12371526a11ea64f62be101289fc089eb85100b9ce7626f" Jul 13 03:41:39.923930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:39.923752 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:39.924444 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:39.923998 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:40.189505 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.189393 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:41:40.189857 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.189823 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" event={"ID":"969cc0b1-f0d3-48e9-9c93-3100c9d37e1d","Type":"ContainerStarted","Data":"2c5ae52eae578a804a0a08bfa310c129019de07f28fe06c23ec52812109ae75b"} Jul 13 03:41:40.190129 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.190107 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:40.195325 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.191368 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:40.195325 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.191453 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:40.209212 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.208949 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:40.209212 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.209093 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:41:40.217907 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.217854 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" podStartSLOduration=9.785482387 podStartE2EDuration="30.217836125s" totalImagesPullingTime="20.432353738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:40.216144504 +0000 UTC m=+30.827171300" watchObservedRunningTime="2026-07-13 03:41:40.217836125 +0000 UTC m=+30.828862922" Jul 13 03:41:40.446153 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.446123 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxgxc"] Jul 13 03:41:40.446267 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.446250 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:40.446375 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:40.446354 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:40.449353 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.449327 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jllf"] Jul 13 03:41:40.449528 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.449454 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:40.449700 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:40.449663 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:40.450219 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.450198 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x6ssv"] Jul 13 03:41:40.450307 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:40.450295 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:40.450395 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:40.450377 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:41.193939 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:41.193909 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9ebce7a-2727-48af-ad6a-17e26c8eada0" containerID="cbdc49f151f786738a48209c05fd5b66c0965c36848f3bc80e7006280963caac" exitCode=0 Jul 13 03:41:41.194416 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:41.193999 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerDied","Data":"cbdc49f151f786738a48209c05fd5b66c0965c36848f3bc80e7006280963caac"} Jul 13 03:41:41.922504 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:41.922452 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:41.922504 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:41.922467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:41.922735 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:41.922593 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:41.922735 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:41.922641 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:41.922735 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:41.922672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:41.922893 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:41.922762 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:42.935601 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:42.935524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:42.935601 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:42.935558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:42.935601 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:42.935576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935663 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935664 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935682 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935699 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935709 2566 projected.go:196] Error preparing data for projected volume kube-api-access-cphkr for pod openshift-network-diagnostics/network-check-target-x6ssv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935714 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs podName:b5937711-ef4e-47e3-baf2-e1bed6c7e1c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:14.935699383 +0000 UTC m=+65.546726161 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs") pod "network-metrics-daemon-4jllf" (UID: "b5937711-ef4e-47e3-baf2-e1bed6c7e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935726 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret podName:a9b72b47-ed1e-466e-bafb-9069b5d4e30a nodeName:}" failed. No retries permitted until 2026-07-13 03:42:14.935720889 +0000 UTC m=+65.546747664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret") pod "global-pull-secret-syncer-rxgxc" (UID: "a9b72b47-ed1e-466e-bafb-9069b5d4e30a") : object "kube-system"/"original-pull-secret" not registered Jul 13 03:41:42.936019 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:42.935742 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr podName:b000cdb6-c30f-4c00-9735-db852b13ec82 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:14.935730877 +0000 UTC m=+65.546757656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cphkr" (UniqueName: "kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr") pod "network-check-target-x6ssv" (UID: "b000cdb6-c30f-4c00-9735-db852b13ec82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 03:41:43.201790 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:43.201700 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9ebce7a-2727-48af-ad6a-17e26c8eada0" containerID="d466fe69c1ec3042e034f3a0885d578238a4021e5f16a3985d39d6847ab40eb8" exitCode=0 Jul 13 03:41:43.201790 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:43.201749 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerDied","Data":"d466fe69c1ec3042e034f3a0885d578238a4021e5f16a3985d39d6847ab40eb8"} Jul 13 03:41:43.923087 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:43.923057 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:43.923087 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:43.923068 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:43.923087 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:43.923057 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:43.923353 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:43.923161 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxgxc" podUID="a9b72b47-ed1e-466e-bafb-9069b5d4e30a" Jul 13 03:41:43.923353 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:43.923205 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x6ssv" podUID="b000cdb6-c30f-4c00-9735-db852b13ec82" Jul 13 03:41:43.923353 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:43.923317 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jllf" podUID="b5937711-ef4e-47e3-baf2-e1bed6c7e1c1" Jul 13 03:41:45.643123 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.643093 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeReady" Jul 13 03:41:45.643508 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.643254 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 03:41:45.674308 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.674094 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg"] Jul 13 03:41:45.676166 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.676148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.678142 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.678116 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt"] Jul 13 03:41:45.679161 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679136 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j4xdq\"" Jul 13 03:41:45.679251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679200 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 03:41:45.679251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679235 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.679251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679165 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.679402 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679239 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 03:41:45.679861 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679840 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67"] Jul 13 03:41:45.680011 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.679974 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" Jul 13 03:41:45.681743 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.681723 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c5f7bbb6f-klcp8"] Jul 13 03:41:45.681877 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.681849 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:45.682383 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.682351 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.682498 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.682388 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.682656 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.682635 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tkc8f\"" Jul 13 03:41:45.683546 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.683317 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-ls5tw"] Jul 13 03:41:45.683642 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.683523 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.684996 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.684966 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.685093 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.684967 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 03:41:45.685305 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.685285 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.685778 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.685759 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v8wj6\"" Jul 13 03:41:45.686251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.686232 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 03:41:45.686251 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.686246 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.686575 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.686553 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 03:41:45.686688 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.686670 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 03:41:45.686791 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.686758 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qj9qk\"" Jul 13 03:41:45.689285 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.689265 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.690154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.689504 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 03:41:45.690154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.689914 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 03:41:45.690154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.690058 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bnfzv\"" Jul 13 03:41:45.690418 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.690241 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.690512 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.690439 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg"] Jul 13 03:41:45.696947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.696921 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt"] Jul 13 03:41:45.697788 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.697770 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67"] Jul 13 03:41:45.698410 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.698391 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 03:41:45.699946 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.699904 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 03:41:45.700915 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.700888 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-ls5tw"] Jul 13 03:41:45.702457 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.702438 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d"] Jul 13 03:41:45.709382 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.707746 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78"] Jul 13 03:41:45.709382 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.709110 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.710554 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.710533 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jr4xz"] Jul 13 03:41:45.710798 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.710655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.712037 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.712016 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 03:41:45.712950 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.712927 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 03:41:45.713225 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.713202 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.714283 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.714261 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7l5pf\"" Jul 13 03:41:45.717041 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.717019 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.717179 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.717166 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 03:41:45.717348 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.717331 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ssn6f\"" Jul 13 03:41:45.717573 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.717554 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.717794 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.717777 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.718142 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.718122 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 03:41:45.721449 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.719934 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5f7bbb6f-klcp8"] Jul 13 03:41:45.721449 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.719979 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sc6nq"] Jul 13 03:41:45.721449 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.720156 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.721860 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.721833 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kw4gq"] Jul 13 03:41:45.722119 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.722103 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.724819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.724395 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75849b74f4-57j5n"] Jul 13 03:41:45.724915 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.724830 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.725047 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.725026 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 03:41:45.726724 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.725243 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 03:41:45.726866 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.726847 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rlgcr"] Jul 13 03:41:45.727111 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.725368 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.727785 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.727766 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 03:41:45.728010 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.727787 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.728671 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.727868 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.728808 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.728400 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.729350 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.729334 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.729578 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.729551 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tj96r\"" Jul 13 03:41:45.729738 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.729470 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 03:41:45.729873 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.729541 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 03:41:45.730263 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.729727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjttq\"" Jul 13 03:41:45.730263 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.729447 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2hcb6\"" Jul 13 03:41:45.730263 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.730114 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch"] Jul 13 03:41:45.731309 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.731057 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:45.732415 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732395 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d"] Jul 13 03:41:45.732415 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732407 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q2xrs\"" Jul 13 03:41:45.732585 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732429 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78"] Jul 13 03:41:45.732585 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732449 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jr4xz"] Jul 13 03:41:45.732585 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732466 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sc6nq"] Jul 13 03:41:45.732585 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732504 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rlgcr"] Jul 13 03:41:45.732585 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732582 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" Jul 13 03:41:45.732953 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732910 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 03:41:45.732953 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.732948 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 03:41:45.734474 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.733162 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.734474 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.733332 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kw4gq"] Jul 13 03:41:45.734474 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734007 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 03:41:45.734474 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734345 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jq8qx\"" Jul 13 03:41:45.734474 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734387 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 03:41:45.734778 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734572 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75849b74f4-57j5n"] Jul 13 03:41:45.734778 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734349 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 03:41:45.734778 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734703 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 03:41:45.734778 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734713 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 03:41:45.734965 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.734856 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.735156 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.735140 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 03:41:45.735367 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.735348 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 03:41:45.735710 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.735694 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4vdn\"" Jul 13 03:41:45.739675 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.739654 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch"] Jul 13 03:41:45.760124 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk5zx\" (UniqueName: \"kubernetes.io/projected/1678db10-807b-4022-a8a5-23156692eb49-kube-api-access-lk5zx\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.760242 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2301587-1e02-45b5-9660-b445e23c4c16-ca-trust-extracted\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760242 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1678db10-807b-4022-a8a5-23156692eb49-config\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.760242 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e85eb09d-160a-4f39-952d-8ec0b124ff6c-config\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.760390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fwxs\" (UniqueName: \"kubernetes.io/projected/60db5188-05f4-41e4-a068-c6172faec175-kube-api-access-7fwxs\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:45.760390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-trusted-ca\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-installation-pull-secrets\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1678db10-807b-4022-a8a5-23156692eb49-serving-cert\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.760390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1678db10-807b-4022-a8a5-23156692eb49-trusted-ca\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fngxt\" (UniqueName: \"kubernetes.io/projected/d66efce8-7b87-4ba9-a323-64982e55f9e1-kube-api-access-fngxt\") pod \"volume-data-source-validator-78495597f6-c4kwt\" (UID: \"d66efce8-7b87-4ba9-a323-64982e55f9e1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8774\" (UniqueName: \"kubernetes.io/projected/e85eb09d-160a-4f39-952d-8ec0b124ff6c-kube-api-access-j8774\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-image-registry-private-configuration\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-registry-certificates\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-bound-sa-token\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760659 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:45.760995 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89blq\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-kube-api-access-89blq\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.760995 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.760702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e85eb09d-160a-4f39-952d-8ec0b124ff6c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.861871 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.861839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c74t\" (UniqueName: \"kubernetes.io/projected/fa219b51-6100-4f80-a060-cd6a92499e2f-kube-api-access-8c74t\") pod \"network-check-source-869dcfcdcd-clzch\" (UID: \"fa219b51-6100-4f80-a060-cd6a92499e2f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" Jul 13 03:41:45.862017 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.861882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk5zx\" (UniqueName: \"kubernetes.io/projected/1678db10-807b-4022-a8a5-23156692eb49-kube-api-access-lk5zx\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.862017 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.861898 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.862017 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.861954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1678db10-807b-4022-a8a5-23156692eb49-config\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.862110 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e85eb09d-160a-4f39-952d-8ec0b124ff6c-config\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.862146 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2301587-1e02-45b5-9660-b445e23c4c16-ca-trust-extracted\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.862146 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7klj2\" (UniqueName: \"kubernetes.io/projected/c7d08be5-f84e-45ef-8af3-be89af94bef4-kube-api-access-7klj2\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.862220 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fwxs\" (UniqueName: \"kubernetes.io/projected/60db5188-05f4-41e4-a068-c6172faec175-kube-api-access-7fwxs\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:45.862220 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-installation-pull-secrets\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.862220 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1678db10-807b-4022-a8a5-23156692eb49-serving-cert\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.862352 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862240 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8774\" (UniqueName: \"kubernetes.io/projected/e85eb09d-160a-4f39-952d-8ec0b124ff6c-kube-api-access-j8774\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.862352 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d5eb82-345f-4b31-9dfc-a99144942c32-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.862352 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-snapshots\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.862352 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-stats-auth\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.862566 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkr2\" (UniqueName: \"kubernetes.io/projected/dbf5a046-4748-4afc-a098-67de1582b9ff-kube-api-access-mpkr2\") pod \"ingress-canary-sc6nq\" (UID: \"dbf5a046-4748-4afc-a098-67de1582b9ff\") " pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.862566 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.862566 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862420 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.862566 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-registry-certificates\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.862566 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26698947-2633-48e2-b49c-26595c53eafd-tmp-dir\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.862566 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862549 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2301587-1e02-45b5-9660-b445e23c4c16-ca-trust-extracted\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xc4s\" (UniqueName: \"kubernetes.io/projected/26698947-2633-48e2-b49c-26595c53eafd-kube-api-access-9xc4s\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgxw5\" (UniqueName: \"kubernetes.io/projected/b9d5eb82-345f-4b31-9dfc-a99144942c32-kube-api-access-pgxw5\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e85eb09d-160a-4f39-952d-8ec0b124ff6c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862732 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1678db10-807b-4022-a8a5-23156692eb49-config\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2589615c-36ca-464a-871e-f69e74cfb2f7-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862795 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e85eb09d-160a-4f39-952d-8ec0b124ff6c-config\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.862852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26698947-2633-48e2-b49c-26595c53eafd-config-volume\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.863194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.862954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-trusted-ca\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.863194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d5eb82-345f-4b31-9dfc-a99144942c32-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.863194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.863194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863084 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-registry-certificates\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.863194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf5a046-4748-4afc-a098-67de1582b9ff-cert\") pod \"ingress-canary-sc6nq\" (UID: \"dbf5a046-4748-4afc-a098-67de1582b9ff\") " pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.863194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-default-certificate\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1678db10-807b-4022-a8a5-23156692eb49-trusted-ca\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fngxt\" (UniqueName: \"kubernetes.io/projected/d66efce8-7b87-4ba9-a323-64982e55f9e1-kube-api-access-fngxt\") pod \"volume-data-source-validator-78495597f6-c4kwt\" (UID: \"d66efce8-7b87-4ba9-a323-64982e55f9e1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-tmp\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-serving-cert\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tst6\" (UniqueName: \"kubernetes.io/projected/2589615c-36ca-464a-871e-f69e74cfb2f7-kube-api-access-8tst6\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzw6k\" (UniqueName: \"kubernetes.io/projected/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-kube-api-access-vzw6k\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-image-registry-private-configuration\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-bound-sa-token\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11807f63-2cb3-46cf-9b11-23b24265ab75-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:45.864188 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.863816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89blq\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-kube-api-access-89blq\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.864322 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1678db10-807b-4022-a8a5-23156692eb49-trusted-ca\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.864662 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-trusted-ca\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.864677 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.864694 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5f7bbb6f-klcp8: secret "image-registry-tls" not found Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.864758 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls podName:b2301587-1e02-45b5-9660-b445e23c4c16 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.36474203 +0000 UTC m=+36.975768806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls") pod "image-registry-7c5f7bbb6f-klcp8" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16") : secret "image-registry-tls" not found Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.864763 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:41:45.864923 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.864824 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls podName:60db5188-05f4-41e4-a068-c6172faec175 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.364808148 +0000 UTC m=+36.975834928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls") pod "cluster-samples-operator-65db858894-xtm67" (UID: "60db5188-05f4-41e4-a068-c6172faec175") : secret "samples-operator-tls" not found Jul 13 03:41:45.867189 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.867165 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e85eb09d-160a-4f39-952d-8ec0b124ff6c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.867297 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.867171 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1678db10-807b-4022-a8a5-23156692eb49-serving-cert\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.867297 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.867253 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-image-registry-private-configuration\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.867386 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.867303 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-installation-pull-secrets\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.870876 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.870855 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fngxt\" (UniqueName: \"kubernetes.io/projected/d66efce8-7b87-4ba9-a323-64982e55f9e1-kube-api-access-fngxt\") pod \"volume-data-source-validator-78495597f6-c4kwt\" (UID: \"d66efce8-7b87-4ba9-a323-64982e55f9e1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" Jul 13 03:41:45.871452 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.871429 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk5zx\" (UniqueName: \"kubernetes.io/projected/1678db10-807b-4022-a8a5-23156692eb49-kube-api-access-lk5zx\") pod \"console-operator-7866497494-ls5tw\" (UID: \"1678db10-807b-4022-a8a5-23156692eb49\") " pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:45.871810 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.871791 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89blq\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-kube-api-access-89blq\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.871896 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.871847 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fwxs\" (UniqueName: \"kubernetes.io/projected/60db5188-05f4-41e4-a068-c6172faec175-kube-api-access-7fwxs\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:45.871991 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.871974 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8774\" (UniqueName: \"kubernetes.io/projected/e85eb09d-160a-4f39-952d-8ec0b124ff6c-kube-api-access-j8774\") pod \"service-ca-operator-7695fc6c8c-kpdwg\" (UID: \"e85eb09d-160a-4f39-952d-8ec0b124ff6c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:45.872884 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.872864 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-bound-sa-token\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:45.927062 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.926989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:41:45.927206 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.926993 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:41:45.927206 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.926993 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:41:45.929529 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.929504 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vc8qt\"" Jul 13 03:41:45.929650 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.929513 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qx94t\"" Jul 13 03:41:45.929650 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.929588 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 03:41:45.929650 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.929510 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 03:41:45.965117 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965093 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.965205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965120 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.965205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965140 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26698947-2633-48e2-b49c-26595c53eafd-tmp-dir\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.965205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xc4s\" (UniqueName: \"kubernetes.io/projected/26698947-2633-48e2-b49c-26595c53eafd-kube-api-access-9xc4s\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.965205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxw5\" (UniqueName: \"kubernetes.io/projected/b9d5eb82-345f-4b31-9dfc-a99144942c32-kube-api-access-pgxw5\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.965205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2589615c-36ca-464a-871e-f69e74cfb2f7-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26698947-2633-48e2-b49c-26595c53eafd-config-volume\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965257 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d5eb82-345f-4b31-9dfc-a99144942c32-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965340 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls podName:26698947-2633-48e2-b49c-26595c53eafd nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.465320047 +0000 UTC m=+37.076346839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls") pod "dns-default-kw4gq" (UID: "26698947-2633-48e2-b49c-26595c53eafd") : secret "dns-default-metrics-tls" not found Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965386 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965455 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls podName:2589615c-36ca-464a-871e-f69e74cfb2f7 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.465440523 +0000 UTC m=+37.076467312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-x8v78" (UID: "2589615c-36ca-464a-871e-f69e74cfb2f7") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf5a046-4748-4afc-a098-67de1582b9ff-cert\") pod \"ingress-canary-sc6nq\" (UID: \"dbf5a046-4748-4afc-a098-67de1582b9ff\") " pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-default-certificate\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.965533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965509 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26698947-2633-48e2-b49c-26595c53eafd-tmp-dir\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-tmp\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-serving-cert\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965648 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tst6\" (UniqueName: \"kubernetes.io/projected/2589615c-36ca-464a-871e-f69e74cfb2f7-kube-api-access-8tst6\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzw6k\" (UniqueName: \"kubernetes.io/projected/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-kube-api-access-vzw6k\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965680 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965741 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.465724477 +0000 UTC m=+37.076751265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : secret "router-metrics-certs-default" not found Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965799 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11807f63-2cb3-46cf-9b11-23b24265ab75-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.965850 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert podName:11807f63-2cb3-46cf-9b11-23b24265ab75 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.465836709 +0000 UTC m=+37.076863500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rlgcr" (UID: "11807f63-2cb3-46cf-9b11-23b24265ab75") : secret "networking-console-plugin-cert" not found Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c74t\" (UniqueName: \"kubernetes.io/projected/fa219b51-6100-4f80-a060-cd6a92499e2f-kube-api-access-8c74t\") pod \"network-check-source-869dcfcdcd-clzch\" (UID: \"fa219b51-6100-4f80-a060-cd6a92499e2f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.966098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965914 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-tmp\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.965962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7klj2\" (UniqueName: \"kubernetes.io/projected/c7d08be5-f84e-45ef-8af3-be89af94bef4-kube-api-access-7klj2\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d5eb82-345f-4b31-9dfc-a99144942c32-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966041 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26698947-2633-48e2-b49c-26595c53eafd-config-volume\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-snapshots\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-stats-auth\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:45.966157 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:46.466139931 +0000 UTC m=+37.077166722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : configmap references non-existent config key: service-ca.crt Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966200 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d5eb82-345f-4b31-9dfc-a99144942c32-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966204 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkr2\" (UniqueName: \"kubernetes.io/projected/dbf5a046-4748-4afc-a098-67de1582b9ff-kube-api-access-mpkr2\") pod \"ingress-canary-sc6nq\" (UID: \"dbf5a046-4748-4afc-a098-67de1582b9ff\") " pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2589615c-36ca-464a-871e-f69e74cfb2f7-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966227 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966515 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11807f63-2cb3-46cf-9b11-23b24265ab75-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:45.966869 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.966836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-snapshots\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.967435 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.967160 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.968987 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.968960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d5eb82-345f-4b31-9dfc-a99144942c32-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.968987 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.968970 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-default-certificate\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.969120 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.969033 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-serving-cert\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.969120 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.969035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-stats-auth\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.969273 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.969246 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbf5a046-4748-4afc-a098-67de1582b9ff-cert\") pod \"ingress-canary-sc6nq\" (UID: \"dbf5a046-4748-4afc-a098-67de1582b9ff\") " pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.977600 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.977563 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xc4s\" (UniqueName: \"kubernetes.io/projected/26698947-2633-48e2-b49c-26595c53eafd-kube-api-access-9xc4s\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:45.978170 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.978146 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tst6\" (UniqueName: \"kubernetes.io/projected/2589615c-36ca-464a-871e-f69e74cfb2f7-kube-api-access-8tst6\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:45.978423 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.978405 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkr2\" (UniqueName: \"kubernetes.io/projected/dbf5a046-4748-4afc-a098-67de1582b9ff-kube-api-access-mpkr2\") pod \"ingress-canary-sc6nq\" (UID: \"dbf5a046-4748-4afc-a098-67de1582b9ff\") " pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:45.978613 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.978593 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzw6k\" (UniqueName: \"kubernetes.io/projected/fc207ea4-221c-4cc7-9172-ccb65cd7bed7-kube-api-access-vzw6k\") pod \"insights-operator-68d9dd94cf-jr4xz\" (UID: \"fc207ea4-221c-4cc7-9172-ccb65cd7bed7\") " pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:45.979056 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.979035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7klj2\" (UniqueName: \"kubernetes.io/projected/c7d08be5-f84e-45ef-8af3-be89af94bef4-kube-api-access-7klj2\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:45.979092 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.979062 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c74t\" (UniqueName: \"kubernetes.io/projected/fa219b51-6100-4f80-a060-cd6a92499e2f-kube-api-access-8c74t\") pod \"network-check-source-869dcfcdcd-clzch\" (UID: \"fa219b51-6100-4f80-a060-cd6a92499e2f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" Jul 13 03:41:45.979443 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.979429 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgxw5\" (UniqueName: \"kubernetes.io/projected/b9d5eb82-345f-4b31-9dfc-a99144942c32-kube-api-access-pgxw5\") pod \"kube-storage-version-migrator-operator-799cb7f958-xpq6d\" (UID: \"b9d5eb82-345f-4b31-9dfc-a99144942c32\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:45.990326 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:45.990310 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" Jul 13 03:41:46.001881 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.001862 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" Jul 13 03:41:46.036250 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.036049 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" Jul 13 03:41:46.043674 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.043439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:41:46.058391 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.058199 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" Jul 13 03:41:46.065107 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.064848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sc6nq" Jul 13 03:41:46.090712 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.090416 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" Jul 13 03:41:46.235426 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.235285 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg"] Jul 13 03:41:46.237075 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.237052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt"] Jul 13 03:41:46.245433 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.242106 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85eb09d_160a_4f39_952d_8ec0b124ff6c.slice/crio-186c76d8242d5aaf2e3e4280071b51c3523d8b9a1f20f83deae52f7454a07638 WatchSource:0}: Error finding container 186c76d8242d5aaf2e3e4280071b51c3523d8b9a1f20f83deae52f7454a07638: Status 404 returned error can't find the container with id 186c76d8242d5aaf2e3e4280071b51c3523d8b9a1f20f83deae52f7454a07638 Jul 13 03:41:46.245433 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.244407 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66efce8_7b87_4ba9_a323_64982e55f9e1.slice/crio-9cdedfdb586fe2a503a3f9bff967bbb1d0cadb5e49a81c16575667ed5a138a30 WatchSource:0}: Error finding container 9cdedfdb586fe2a503a3f9bff967bbb1d0cadb5e49a81c16575667ed5a138a30: Status 404 returned error can't find the container with id 9cdedfdb586fe2a503a3f9bff967bbb1d0cadb5e49a81c16575667ed5a138a30 Jul 13 03:41:46.279982 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.279107 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d"] Jul 13 03:41:46.284931 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.284853 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d5eb82_345f_4b31_9dfc_a99144942c32.slice/crio-b84887cb6de484fd6052c064d25926b8454fdb161b9ead57ee0f867b4c4aedbe WatchSource:0}: Error finding container b84887cb6de484fd6052c064d25926b8454fdb161b9ead57ee0f867b4c4aedbe: Status 404 returned error can't find the container with id b84887cb6de484fd6052c064d25926b8454fdb161b9ead57ee0f867b4c4aedbe Jul 13 03:41:46.314011 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.313983 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-ls5tw"] Jul 13 03:41:46.317200 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.317170 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1678db10_807b_4022_a8a5_23156692eb49.slice/crio-b1905b345cd4a26e96cb3c9a58c570f0c6c192980bd364c8b40f08feeb295059 WatchSource:0}: Error finding container b1905b345cd4a26e96cb3c9a58c570f0c6c192980bd364c8b40f08feeb295059: Status 404 returned error can't find the container with id b1905b345cd4a26e96cb3c9a58c570f0c6c192980bd364c8b40f08feeb295059 Jul 13 03:41:46.323065 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.323035 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sc6nq"] Jul 13 03:41:46.326720 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.326695 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf5a046_4748_4afc_a098_67de1582b9ff.slice/crio-76da81a4b2cbfca7f217a8febc4e007c8517d14308f07cb0ff3895a5a6c4da9a WatchSource:0}: Error finding container 76da81a4b2cbfca7f217a8febc4e007c8517d14308f07cb0ff3895a5a6c4da9a: Status 404 returned error can't find the container with id 76da81a4b2cbfca7f217a8febc4e007c8517d14308f07cb0ff3895a5a6c4da9a Jul 13 03:41:46.334324 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.334300 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch"] Jul 13 03:41:46.337628 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.337606 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa219b51_6100_4f80_a060_cd6a92499e2f.slice/crio-63a3975fa9e4e4e96eb79d2b1750e0e4abcf4d089bd1115969592ec1a9f15ed3 WatchSource:0}: Error finding container 63a3975fa9e4e4e96eb79d2b1750e0e4abcf4d089bd1115969592ec1a9f15ed3: Status 404 returned error can't find the container with id 63a3975fa9e4e4e96eb79d2b1750e0e4abcf4d089bd1115969592ec1a9f15ed3 Jul 13 03:41:46.341220 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.341197 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jr4xz"] Jul 13 03:41:46.344340 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:46.344317 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc207ea4_221c_4cc7_9172_ccb65cd7bed7.slice/crio-fa51cde138a922ddb5c1732c8aee54f39b7c73985c80540e6719b8b006dc3e2a WatchSource:0}: Error finding container fa51cde138a922ddb5c1732c8aee54f39b7c73985c80540e6719b8b006dc3e2a: Status 404 returned error can't find the container with id fa51cde138a922ddb5c1732c8aee54f39b7c73985c80540e6719b8b006dc3e2a Jul 13 03:41:46.376330 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.376303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:46.376462 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.376358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:46.376569 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.376473 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:41:46.376569 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.376505 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:41:46.376569 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.376513 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5f7bbb6f-klcp8: secret "image-registry-tls" not found Jul 13 03:41:46.376569 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.376568 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls podName:60db5188-05f4-41e4-a068-c6172faec175 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.376547332 +0000 UTC m=+37.987574131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls") pod "cluster-samples-operator-65db858894-xtm67" (UID: "60db5188-05f4-41e4-a068-c6172faec175") : secret "samples-operator-tls" not found Jul 13 03:41:46.376732 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.376589 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls podName:b2301587-1e02-45b5-9660-b445e23c4c16 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.376579577 +0000 UTC m=+37.987606359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls") pod "image-registry-7c5f7bbb6f-klcp8" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16") : secret "image-registry-tls" not found Jul 13 03:41:46.477287 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.477178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:46.477287 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.477245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:46.477287 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.477288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477355 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477386 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477415 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.477361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477425 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls podName:26698947-2633-48e2-b49c-26595c53eafd nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.477406245 +0000 UTC m=+38.088433021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls") pod "dns-default-kw4gq" (UID: "26698947-2633-48e2-b49c-26595c53eafd") : secret "dns-default-metrics-tls" not found Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477460 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477503 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.477470864 +0000 UTC m=+38.088497653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : secret "router-metrics-certs-default" not found Jul 13 03:41:46.477562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477547 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert podName:11807f63-2cb3-46cf-9b11-23b24265ab75 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.47753062 +0000 UTC m=+38.088557412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rlgcr" (UID: "11807f63-2cb3-46cf-9b11-23b24265ab75") : secret "networking-console-plugin-cert" not found Jul 13 03:41:46.477899 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477572 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls podName:2589615c-36ca-464a-871e-f69e74cfb2f7 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.477562426 +0000 UTC m=+38.088589204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-x8v78" (UID: "2589615c-36ca-464a-871e-f69e74cfb2f7") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:46.477899 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:46.477640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:46.477899 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:46.477762 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:47.477750585 +0000 UTC m=+38.088777359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : configmap references non-existent config key: service-ca.crt Jul 13 03:41:47.227192 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.227153 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" event={"ID":"e85eb09d-160a-4f39-952d-8ec0b124ff6c","Type":"ContainerStarted","Data":"186c76d8242d5aaf2e3e4280071b51c3523d8b9a1f20f83deae52f7454a07638"} Jul 13 03:41:47.228372 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.228336 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" event={"ID":"fa219b51-6100-4f80-a060-cd6a92499e2f","Type":"ContainerStarted","Data":"63a3975fa9e4e4e96eb79d2b1750e0e4abcf4d089bd1115969592ec1a9f15ed3"} Jul 13 03:41:47.229610 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.229572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" event={"ID":"d66efce8-7b87-4ba9-a323-64982e55f9e1","Type":"ContainerStarted","Data":"9cdedfdb586fe2a503a3f9bff967bbb1d0cadb5e49a81c16575667ed5a138a30"} Jul 13 03:41:47.230716 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.230690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" event={"ID":"fc207ea4-221c-4cc7-9172-ccb65cd7bed7","Type":"ContainerStarted","Data":"fa51cde138a922ddb5c1732c8aee54f39b7c73985c80540e6719b8b006dc3e2a"} Jul 13 03:41:47.231836 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.231812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ls5tw" event={"ID":"1678db10-807b-4022-a8a5-23156692eb49","Type":"ContainerStarted","Data":"b1905b345cd4a26e96cb3c9a58c570f0c6c192980bd364c8b40f08feeb295059"} Jul 13 03:41:47.232934 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.232915 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" event={"ID":"b9d5eb82-345f-4b31-9dfc-a99144942c32","Type":"ContainerStarted","Data":"b84887cb6de484fd6052c064d25926b8454fdb161b9ead57ee0f867b4c4aedbe"} Jul 13 03:41:47.234107 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.234084 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sc6nq" event={"ID":"dbf5a046-4748-4afc-a098-67de1582b9ff","Type":"ContainerStarted","Data":"76da81a4b2cbfca7f217a8febc4e007c8517d14308f07cb0ff3895a5a6c4da9a"} Jul 13 03:41:47.386725 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.386691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:47.386888 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.386778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:47.386888 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.386868 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:41:47.386975 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.386890 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5f7bbb6f-klcp8: secret "image-registry-tls" not found Jul 13 03:41:47.386975 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.386892 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:41:47.386975 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.386955 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls podName:b2301587-1e02-45b5-9660-b445e23c4c16 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.386932812 +0000 UTC m=+39.997959587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls") pod "image-registry-7c5f7bbb6f-klcp8" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16") : secret "image-registry-tls" not found Jul 13 03:41:47.386975 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.386975 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls podName:60db5188-05f4-41e4-a068-c6172faec175 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.386965844 +0000 UTC m=+39.997992619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls") pod "cluster-samples-operator-65db858894-xtm67" (UID: "60db5188-05f4-41e4-a068-c6172faec175") : secret "samples-operator-tls" not found Jul 13 03:41:47.487334 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.487244 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:47.487334 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.487318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:47.487562 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.487382 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:47.487562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487422 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:47.487562 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.487442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:47.487562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487466 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:41:47.487562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487513 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls podName:2589615c-36ca-464a-871e-f69e74cfb2f7 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.487473623 +0000 UTC m=+40.098500419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-x8v78" (UID: "2589615c-36ca-464a-871e-f69e74cfb2f7") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:47.487562 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487545 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.487527684 +0000 UTC m=+40.098554464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : secret "router-metrics-certs-default" not found Jul 13 03:41:47.487836 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487564 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 03:41:47.487836 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487585 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.487569578 +0000 UTC m=+40.098596575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : configmap references non-existent config key: service-ca.crt Jul 13 03:41:47.487836 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:47.487609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:47.487836 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487615 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert podName:11807f63-2cb3-46cf-9b11-23b24265ab75 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.487600706 +0000 UTC m=+40.098627483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rlgcr" (UID: "11807f63-2cb3-46cf-9b11-23b24265ab75") : secret "networking-console-plugin-cert" not found Jul 13 03:41:47.487836 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487693 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 03:41:47.487836 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:47.487744 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls podName:26698947-2633-48e2-b49c-26595c53eafd nodeName:}" failed. No retries permitted until 2026-07-13 03:41:49.487729797 +0000 UTC m=+40.098756586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls") pod "dns-default-kw4gq" (UID: "26698947-2633-48e2-b49c-26595c53eafd") : secret "dns-default-metrics-tls" not found Jul 13 03:41:48.245966 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:48.245843 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9ebce7a-2727-48af-ad6a-17e26c8eada0" containerID="f271f08b32339c9542f389c2dd4195e817ccba75e0c8e426b10626077ed4de48" exitCode=0 Jul 13 03:41:48.245966 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:48.245916 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerDied","Data":"f271f08b32339c9542f389c2dd4195e817ccba75e0c8e426b10626077ed4de48"} Jul 13 03:41:49.257782 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.257742 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9ebce7a-2727-48af-ad6a-17e26c8eada0" containerID="0d9d3180d0d8ff22611ee943a447228739c3b576d62d96800343122650edf4f1" exitCode=0 Jul 13 03:41:49.259217 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.257838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerDied","Data":"0d9d3180d0d8ff22611ee943a447228739c3b576d62d96800343122650edf4f1"} Jul 13 03:41:49.409595 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.409556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:49.409759 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.409623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:49.410601 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.410578 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:41:49.410695 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.410653 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls podName:60db5188-05f4-41e4-a068-c6172faec175 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.410633749 +0000 UTC m=+44.021660526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls") pod "cluster-samples-operator-65db858894-xtm67" (UID: "60db5188-05f4-41e4-a068-c6172faec175") : secret "samples-operator-tls" not found Jul 13 03:41:49.411244 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.411224 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:41:49.411316 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.411250 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5f7bbb6f-klcp8: secret "image-registry-tls" not found Jul 13 03:41:49.411316 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.411296 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls podName:b2301587-1e02-45b5-9660-b445e23c4c16 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.411280945 +0000 UTC m=+44.022307727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls") pod "image-registry-7c5f7bbb6f-klcp8" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16") : secret "image-registry-tls" not found Jul 13 03:41:49.510816 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.510722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:49.510816 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.510808 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:49.511046 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.510872 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:49.511046 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.510931 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:49.511046 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:49.511005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:49.511161 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.511131 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:49.511212 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.511201 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls podName:2589615c-36ca-464a-871e-f69e74cfb2f7 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.511179185 +0000 UTC m=+44.122205980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-x8v78" (UID: "2589615c-36ca-464a-871e-f69e74cfb2f7") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:49.511855 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.511834 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:41:49.511961 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.511947 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.511930525 +0000 UTC m=+44.122957315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : secret "router-metrics-certs-default" not found Jul 13 03:41:49.512041 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.512010 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 03:41:49.512092 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.512041 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert podName:11807f63-2cb3-46cf-9b11-23b24265ab75 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.512030791 +0000 UTC m=+44.123057571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rlgcr" (UID: "11807f63-2cb3-46cf-9b11-23b24265ab75") : secret "networking-console-plugin-cert" not found Jul 13 03:41:49.512156 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.512101 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.512090697 +0000 UTC m=+44.123117493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : configmap references non-existent config key: service-ca.crt Jul 13 03:41:49.512288 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.512272 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 03:41:49.512364 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:49.512352 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls podName:26698947-2633-48e2-b49c-26595c53eafd nodeName:}" failed. No retries permitted until 2026-07-13 03:41:53.512306514 +0000 UTC m=+44.123333305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls") pod "dns-default-kw4gq" (UID: "26698947-2633-48e2-b49c-26595c53eafd") : secret "dns-default-metrics-tls" not found Jul 13 03:41:50.267266 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:50.267034 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" event={"ID":"b9ebce7a-2727-48af-ad6a-17e26c8eada0","Type":"ContainerStarted","Data":"a23d9c100fd426e7c069815833ae98013c0231baaa1ab9a95c39ab3a9ab3db74"} Jul 13 03:41:50.269695 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:50.269666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" event={"ID":"d66efce8-7b87-4ba9-a323-64982e55f9e1","Type":"ContainerStarted","Data":"b9f82136a80e01809b8af6af571a372821060f9e5fd58a52a45ba964aac8433a"} Jul 13 03:41:50.289674 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:50.289388 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fhf7m" podStartSLOduration=8.536446949 podStartE2EDuration="40.289366075s" totalImagesPullingTime="31.752919126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:50.286694835 +0000 UTC m=+40.897721655" watchObservedRunningTime="2026-07-13 03:41:50.289366075 +0000 UTC m=+40.900392854" Jul 13 03:41:50.300612 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:50.300559 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4kwt" podStartSLOduration=18.634665288 podStartE2EDuration="22.300540831s" totalImagesPullingTime="3.665875543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:50.300042463 +0000 UTC m=+40.911069261" watchObservedRunningTime="2026-07-13 03:41:50.300540831 +0000 UTC m=+40.911567629" Jul 13 03:41:53.452838 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.452798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:41:53.453343 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.452857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:41:53.453343 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.452980 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:41:53.453343 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.453006 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5f7bbb6f-klcp8: secret "image-registry-tls" not found Jul 13 03:41:53.453343 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.453032 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:41:53.453343 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.453078 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls podName:b2301587-1e02-45b5-9660-b445e23c4c16 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.453054614 +0000 UTC m=+52.064081404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls") pod "image-registry-7c5f7bbb6f-klcp8" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16") : secret "image-registry-tls" not found Jul 13 03:41:53.453343 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.453102 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls podName:60db5188-05f4-41e4-a068-c6172faec175 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.453085889 +0000 UTC m=+52.064112664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls") pod "cluster-samples-operator-65db858894-xtm67" (UID: "60db5188-05f4-41e4-a068-c6172faec175") : secret "samples-operator-tls" not found Jul 13 03:41:53.553329 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.553294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:53.553534 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.553352 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:41:53.553534 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.553391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:41:53.553534 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.553425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:41:53.553534 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553472 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:41:53.553534 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553518 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 03:41:53.553534 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:53.553523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553556 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553566 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.553542601 +0000 UTC m=+52.164569389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : secret "router-metrics-certs-default" not found Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553588 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert podName:11807f63-2cb3-46cf-9b11-23b24265ab75 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.553576031 +0000 UTC m=+52.164602810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rlgcr" (UID: "11807f63-2cb3-46cf-9b11-23b24265ab75") : secret "networking-console-plugin-cert" not found Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553604 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.553595828 +0000 UTC m=+52.164622607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : configmap references non-existent config key: service-ca.crt Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553614 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553618 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls podName:26698947-2633-48e2-b49c-26595c53eafd nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.553610429 +0000 UTC m=+52.164637204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls") pod "dns-default-kw4gq" (UID: "26698947-2633-48e2-b49c-26595c53eafd") : secret "dns-default-metrics-tls" not found Jul 13 03:41:53.553814 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:53.553672 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls podName:2589615c-36ca-464a-871e-f69e74cfb2f7 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.553657543 +0000 UTC m=+52.164684332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-x8v78" (UID: "2589615c-36ca-464a-871e-f69e74cfb2f7") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:41:56.289241 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.289073 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sc6nq" event={"ID":"dbf5a046-4748-4afc-a098-67de1582b9ff","Type":"ContainerStarted","Data":"df133708cf46f335c3ccd16252b179dd7e31c7ca6407305a744ef91eb01096da"} Jul 13 03:41:56.290761 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.290731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" event={"ID":"e85eb09d-160a-4f39-952d-8ec0b124ff6c","Type":"ContainerStarted","Data":"1073077de2ff73710d57daa4b241b176a6f2aa34092f7c6043931f67c6a4f3a3"} Jul 13 03:41:56.292262 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.292240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" event={"ID":"fa219b51-6100-4f80-a060-cd6a92499e2f","Type":"ContainerStarted","Data":"7c2ee15880447766d03dc46e72d2c685ca8089bb270919972cb94386da3d425e"} Jul 13 03:41:56.293910 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.293890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" event={"ID":"fc207ea4-221c-4cc7-9172-ccb65cd7bed7","Type":"ContainerStarted","Data":"94da49496db467ba01157bc8322cae755296dcdb6f2d6da41791590e7cdb0bd1"} Jul 13 03:41:56.296029 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.296009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/0.log" Jul 13 03:41:56.296124 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.296049 2566 generic.go:356] "Generic (PLEG): container finished" podID="1678db10-807b-4022-a8a5-23156692eb49" containerID="5097b4b2082dc54ff938ba4b2024f8f23c48fa4a136d8c9052912745b2e1974c" exitCode=255 Jul 13 03:41:56.296124 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.296115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ls5tw" event={"ID":"1678db10-807b-4022-a8a5-23156692eb49","Type":"ContainerDied","Data":"5097b4b2082dc54ff938ba4b2024f8f23c48fa4a136d8c9052912745b2e1974c"} Jul 13 03:41:56.296443 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.296303 2566 scope.go:117] "RemoveContainer" containerID="5097b4b2082dc54ff938ba4b2024f8f23c48fa4a136d8c9052912745b2e1974c" Jul 13 03:41:56.297608 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.297589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" event={"ID":"b9d5eb82-345f-4b31-9dfc-a99144942c32","Type":"ContainerStarted","Data":"0ef186c0b08771a3003fb1f15f9535356125e36aea3b266803217b8648cbaf99"} Jul 13 03:41:56.304604 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.304558 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sc6nq" podStartSLOduration=2.237974525 podStartE2EDuration="11.304542295s" totalImagesPullingTime="9.06656777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:56.303157026 +0000 UTC m=+46.914183825" watchObservedRunningTime="2026-07-13 03:41:56.304542295 +0000 UTC m=+46.915569085" Jul 13 03:41:56.319374 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.319329 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" podStartSLOduration=19.180157689 podStartE2EDuration="28.319310747s" totalImagesPullingTime="9.139153058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:56.31810165 +0000 UTC m=+46.929128448" watchObservedRunningTime="2026-07-13 03:41:56.319310747 +0000 UTC m=+46.930337548" Jul 13 03:41:56.338084 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.336725 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" podStartSLOduration=18.287888459 podStartE2EDuration="27.336705381s" totalImagesPullingTime="9.048816922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:56.335810616 +0000 UTC m=+46.946837415" watchObservedRunningTime="2026-07-13 03:41:56.336705381 +0000 UTC m=+46.947732159" Jul 13 03:41:56.364785 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.364739 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" podStartSLOduration=18.258195738 podStartE2EDuration="27.364719898s" totalImagesPullingTime="9.10652416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:56.36413165 +0000 UTC m=+46.975158446" watchObservedRunningTime="2026-07-13 03:41:56.364719898 +0000 UTC m=+46.975746698" Jul 13 03:41:56.379601 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.379473 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-clzch" podStartSLOduration=19.314337281 podStartE2EDuration="28.379454966s" totalImagesPullingTime="9.065117685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:56.378378223 +0000 UTC m=+46.989405018" watchObservedRunningTime="2026-07-13 03:41:56.379454966 +0000 UTC m=+46.990481765" Jul 13 03:41:56.671963 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.671868 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rd622"] Jul 13 03:41:56.688338 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.687915 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.692403 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.691507 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rd622"] Jul 13 03:41:56.692403 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.691609 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 03:41:56.692403 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.691806 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 03:41:56.692403 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.691872 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5zfx\"" Jul 13 03:41:56.782345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.782314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs66v\" (UniqueName: \"kubernetes.io/projected/ac11700e-0003-4782-8236-0f2462eb7203-kube-api-access-bs66v\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.782345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.782352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac11700e-0003-4782-8236-0f2462eb7203-crio-socket\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.782547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.782409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac11700e-0003-4782-8236-0f2462eb7203-data-volume\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.782547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.782532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.782654 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.782562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.883963 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.883929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs66v\" (UniqueName: \"kubernetes.io/projected/ac11700e-0003-4782-8236-0f2462eb7203-kube-api-access-bs66v\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.884142 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.883981 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac11700e-0003-4782-8236-0f2462eb7203-crio-socket\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.884142 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.884029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac11700e-0003-4782-8236-0f2462eb7203-data-volume\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.884142 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.884095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.884142 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.884113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.884397 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:56.884215 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:41:56.884397 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.884255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac11700e-0003-4782-8236-0f2462eb7203-crio-socket\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.884397 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:56.884283 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:57.384264165 +0000 UTC m=+47.995290944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : configmap "kube-rbac-proxy" not found Jul 13 03:41:56.884397 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:56.884281 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:41:56.884397 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:56.884336 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:57.384320868 +0000 UTC m=+47.995347643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : secret "insights-runtime-extractor-tls" not found Jul 13 03:41:56.884608 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.884468 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac11700e-0003-4782-8236-0f2462eb7203-data-volume\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.895432 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.895409 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs66v\" (UniqueName: \"kubernetes.io/projected/ac11700e-0003-4782-8236-0f2462eb7203-kube-api-access-bs66v\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:56.970721 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.970648 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5"] Jul 13 03:41:56.981538 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.981510 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" Jul 13 03:41:56.982619 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.982590 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5"] Jul 13 03:41:56.983827 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.983799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 03:41:56.983957 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.983938 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6xx57\"" Jul 13 03:41:56.984092 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:56.984077 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 03:41:57.085586 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.085549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb95h\" (UniqueName: \"kubernetes.io/projected/3e799dbc-f3b9-42a7-a09e-ca9e338e0c24-kube-api-access-pb95h\") pod \"migrator-7f59b54f6c-fgbx5\" (UID: \"3e799dbc-f3b9-42a7-a09e-ca9e338e0c24\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" Jul 13 03:41:57.186462 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.186423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb95h\" (UniqueName: \"kubernetes.io/projected/3e799dbc-f3b9-42a7-a09e-ca9e338e0c24-kube-api-access-pb95h\") pod \"migrator-7f59b54f6c-fgbx5\" (UID: \"3e799dbc-f3b9-42a7-a09e-ca9e338e0c24\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" Jul 13 03:41:57.193591 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.193563 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb95h\" (UniqueName: \"kubernetes.io/projected/3e799dbc-f3b9-42a7-a09e-ca9e338e0c24-kube-api-access-pb95h\") pod \"migrator-7f59b54f6c-fgbx5\" (UID: \"3e799dbc-f3b9-42a7-a09e-ca9e338e0c24\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" Jul 13 03:41:57.292136 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.292100 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" Jul 13 03:41:57.301908 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.301883 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:41:57.302300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.302286 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/0.log" Jul 13 03:41:57.302367 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.302322 2566 generic.go:356] "Generic (PLEG): container finished" podID="1678db10-807b-4022-a8a5-23156692eb49" containerID="af268547046d88dca4715effd9ece11d6b3dd7bb1efa12243ceee2acfcb753fd" exitCode=255 Jul 13 03:41:57.302411 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.302396 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ls5tw" event={"ID":"1678db10-807b-4022-a8a5-23156692eb49","Type":"ContainerDied","Data":"af268547046d88dca4715effd9ece11d6b3dd7bb1efa12243ceee2acfcb753fd"} Jul 13 03:41:57.302469 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.302456 2566 scope.go:117] "RemoveContainer" containerID="5097b4b2082dc54ff938ba4b2024f8f23c48fa4a136d8c9052912745b2e1974c" Jul 13 03:41:57.302680 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.302661 2566 scope.go:117] "RemoveContainer" containerID="af268547046d88dca4715effd9ece11d6b3dd7bb1efa12243ceee2acfcb753fd" Jul 13 03:41:57.302863 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:57.302841 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ls5tw_openshift-console-operator(1678db10-807b-4022-a8a5-23156692eb49)\"" pod="openshift-console-operator/console-operator-7866497494-ls5tw" podUID="1678db10-807b-4022-a8a5-23156692eb49" Jul 13 03:41:57.388312 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.388233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:57.388312 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.388293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:57.388568 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:57.388386 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:41:57.388568 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:57.388425 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:41:57.388568 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:57.388462 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:58.388446389 +0000 UTC m=+48.999473168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : secret "insights-runtime-extractor-tls" not found Jul 13 03:41:57.388568 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:57.388510 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:58.388470933 +0000 UTC m=+48.999497710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : configmap "kube-rbac-proxy" not found Jul 13 03:41:57.440769 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.440739 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5"] Jul 13 03:41:57.444202 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:41:57.444174 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e799dbc_f3b9_42a7_a09e_ca9e338e0c24.slice/crio-a00201e85ae59200160345565fcd9e0ea5d220457cf7bdf08c5971f359de2e42 WatchSource:0}: Error finding container a00201e85ae59200160345565fcd9e0ea5d220457cf7bdf08c5971f359de2e42: Status 404 returned error can't find the container with id a00201e85ae59200160345565fcd9e0ea5d220457cf7bdf08c5971f359de2e42 Jul 13 03:41:57.869343 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:57.869319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sb8vh_1f169a86-02b5-4edb-82fe-991e59579698/dns-node-resolver/0.log" Jul 13 03:41:58.306897 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:58.306870 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:41:58.307346 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:58.307277 2566 scope.go:117] "RemoveContainer" containerID="af268547046d88dca4715effd9ece11d6b3dd7bb1efa12243ceee2acfcb753fd" Jul 13 03:41:58.307531 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:58.307473 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ls5tw_openshift-console-operator(1678db10-807b-4022-a8a5-23156692eb49)\"" pod="openshift-console-operator/console-operator-7866497494-ls5tw" podUID="1678db10-807b-4022-a8a5-23156692eb49" Jul 13 03:41:58.308078 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:58.308059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" event={"ID":"3e799dbc-f3b9-42a7-a09e-ca9e338e0c24","Type":"ContainerStarted","Data":"a00201e85ae59200160345565fcd9e0ea5d220457cf7bdf08c5971f359de2e42"} Jul 13 03:41:58.398610 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:58.398576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:58.398810 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:58.398622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:41:58.398810 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:58.398707 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:41:58.398810 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:58.398730 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:41:58.398810 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:58.398777 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:00.398756612 +0000 UTC m=+51.009783387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : configmap "kube-rbac-proxy" not found Jul 13 03:41:58.399032 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:41:58.398863 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:00.398836324 +0000 UTC m=+51.009863114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : secret "insights-runtime-extractor-tls" not found Jul 13 03:41:58.870517 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:58.870045 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-twp2d_43fd49e6-f97a-4eb3-91d0-8ed2a0e04441/node-ca/0.log" Jul 13 03:41:59.312871 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:59.312836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" event={"ID":"3e799dbc-f3b9-42a7-a09e-ca9e338e0c24","Type":"ContainerStarted","Data":"5c98105ee021e9b4ef6ea0a4e38fcac54330f66e71808e7308560cb4cce8da74"} Jul 13 03:41:59.470867 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:41:59.470784 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sc6nq_dbf5a046-4748-4afc-a098-67de1582b9ff/serve-healthcheck-canary/0.log" Jul 13 03:42:00.317966 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:00.317928 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" event={"ID":"3e799dbc-f3b9-42a7-a09e-ca9e338e0c24","Type":"ContainerStarted","Data":"5c57ec8f24df7a34476968e88f343cf0fd5ed1c2b4ed27c4acdc901926dba097"} Jul 13 03:42:00.337979 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:00.337927 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fgbx5" podStartSLOduration=2.663129923 podStartE2EDuration="4.337911849s" totalImagesPullingTime="1.674781926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:00.33694566 +0000 UTC m=+50.947972459" watchObservedRunningTime="2026-07-13 03:42:00.337911849 +0000 UTC m=+50.948938646" Jul 13 03:42:00.414459 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:00.414422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:00.414631 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:00.414468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:00.414631 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:00.414561 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:42:00.414631 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:00.414618 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:04.41460149 +0000 UTC m=+55.025628285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : configmap "kube-rbac-proxy" not found Jul 13 03:42:00.414808 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:00.414701 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:42:00.414808 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:00.414756 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:04.414740766 +0000 UTC m=+55.025767561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : secret "insights-runtime-extractor-tls" not found Jul 13 03:42:01.524260 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.524221 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:42:01.524725 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.524270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:42:01.524725 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.524405 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:42:01.524725 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.524432 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5f7bbb6f-klcp8: secret "image-registry-tls" not found Jul 13 03:42:01.524725 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.524434 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:42:01.524725 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.524517 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls podName:60db5188-05f4-41e4-a068-c6172faec175 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.524477967 +0000 UTC m=+68.135504746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls") pod "cluster-samples-operator-65db858894-xtm67" (UID: "60db5188-05f4-41e4-a068-c6172faec175") : secret "samples-operator-tls" not found Jul 13 03:42:01.524725 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.524534 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls podName:b2301587-1e02-45b5-9660-b445e23c4c16 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.524527334 +0000 UTC m=+68.135554144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls") pod "image-registry-7c5f7bbb6f-klcp8" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16") : secret "image-registry-tls" not found Jul 13 03:42:01.624686 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.624649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:01.624864 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.624702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:42:01.624864 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.624798 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 03:42:01.624864 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.624839 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls podName:26698947-2633-48e2-b49c-26595c53eafd nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.624825645 +0000 UTC m=+68.235852421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls") pod "dns-default-kw4gq" (UID: "26698947-2633-48e2-b49c-26595c53eafd") : secret "dns-default-metrics-tls" not found Jul 13 03:42:01.624864 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.624853 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.62484731 +0000 UTC m=+68.235874085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : configmap references non-existent config key: service-ca.crt Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.624871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.624901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:01.624934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.624997 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.625022 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.625027 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert podName:11807f63-2cb3-46cf-9b11-23b24265ab75 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.625019434 +0000 UTC m=+68.236046209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rlgcr" (UID: "11807f63-2cb3-46cf-9b11-23b24265ab75") : secret "networking-console-plugin-cert" not found Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.625079 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs podName:c7d08be5-f84e-45ef-8af3-be89af94bef4 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.625066927 +0000 UTC m=+68.236093706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs") pod "router-default-75849b74f4-57j5n" (UID: "c7d08be5-f84e-45ef-8af3-be89af94bef4") : secret "router-metrics-certs-default" not found Jul 13 03:42:01.625086 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.625024 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:42:01.625360 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:01.625110 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls podName:2589615c-36ca-464a-871e-f69e74cfb2f7 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:17.625103974 +0000 UTC m=+68.236130748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-x8v78" (UID: "2589615c-36ca-464a-871e-f69e74cfb2f7") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:42:04.447253 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:04.447201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:04.447253 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:04.447255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:04.447906 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:04.447335 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:42:04.447906 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:04.447390 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:12.44737404 +0000 UTC m=+63.058400815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : configmap "kube-rbac-proxy" not found Jul 13 03:42:04.447906 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:04.447398 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:42:04.447906 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:04.447469 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:12.447453852 +0000 UTC m=+63.058480631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : secret "insights-runtime-extractor-tls" not found Jul 13 03:42:06.044785 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:06.044753 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:42:06.045154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:06.044817 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:42:06.045154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:06.045138 2566 scope.go:117] "RemoveContainer" containerID="af268547046d88dca4715effd9ece11d6b3dd7bb1efa12243ceee2acfcb753fd" Jul 13 03:42:06.045318 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:06.045298 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ls5tw_openshift-console-operator(1678db10-807b-4022-a8a5-23156692eb49)\"" pod="openshift-console-operator/console-operator-7866497494-ls5tw" podUID="1678db10-807b-4022-a8a5-23156692eb49" Jul 13 03:42:12.217293 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:12.217254 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4f6ms" Jul 13 03:42:12.519725 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:12.519692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:12.519882 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:12.519733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:12.519882 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:12.519841 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:42:12.519970 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:12.519902 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls podName:ac11700e-0003-4782-8236-0f2462eb7203 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:28.519885886 +0000 UTC m=+79.130912664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rd622" (UID: "ac11700e-0003-4782-8236-0f2462eb7203") : secret "insights-runtime-extractor-tls" not found Jul 13 03:42:12.520239 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:12.520222 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac11700e-0003-4782-8236-0f2462eb7203-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:14.944158 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.944121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:42:14.944158 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.944159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:42:14.944637 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.944195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:42:14.946718 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.946700 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 03:42:14.946769 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.946700 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cphkr\" (UniqueName: \"kubernetes.io/projected/b000cdb6-c30f-4c00-9735-db852b13ec82-kube-api-access-cphkr\") pod \"network-check-target-x6ssv\" (UID: \"b000cdb6-c30f-4c00-9735-db852b13ec82\") " pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:42:14.947728 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.947714 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 03:42:14.956613 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.956592 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9b72b47-ed1e-466e-bafb-9069b5d4e30a-original-pull-secret\") pod \"global-pull-secret-syncer-rxgxc\" (UID: \"a9b72b47-ed1e-466e-bafb-9069b5d4e30a\") " pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:42:14.956763 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:14.956746 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5937711-ef4e-47e3-baf2-e1bed6c7e1c1-metrics-certs\") pod \"network-metrics-daemon-4jllf\" (UID: \"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1\") " pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:42:15.039123 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.039089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxgxc" Jul 13 03:42:15.047957 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.047932 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qx94t\"" Jul 13 03:42:15.054013 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.053993 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vc8qt\"" Jul 13 03:42:15.056560 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.056195 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jllf" Jul 13 03:42:15.062054 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.062036 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:42:15.186655 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.186542 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxgxc"] Jul 13 03:42:15.189281 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:15.189246 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b72b47_ed1e_466e_bafb_9069b5d4e30a.slice/crio-c50c58cccd230943fe1343815c79dad38b277469d259cc3094dd3dd03f65d65f WatchSource:0}: Error finding container c50c58cccd230943fe1343815c79dad38b277469d259cc3094dd3dd03f65d65f: Status 404 returned error can't find the container with id c50c58cccd230943fe1343815c79dad38b277469d259cc3094dd3dd03f65d65f Jul 13 03:42:15.366334 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.366303 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxgxc" event={"ID":"a9b72b47-ed1e-466e-bafb-9069b5d4e30a","Type":"ContainerStarted","Data":"c50c58cccd230943fe1343815c79dad38b277469d259cc3094dd3dd03f65d65f"} Jul 13 03:42:15.411526 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.411458 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x6ssv"] Jul 13 03:42:15.414224 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:15.414194 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb000cdb6_c30f_4c00_9735_db852b13ec82.slice/crio-75f74722a247e105c3f3a47fbaf73118ad4a04a829177e163458fc6fb3779a7b WatchSource:0}: Error finding container 75f74722a247e105c3f3a47fbaf73118ad4a04a829177e163458fc6fb3779a7b: Status 404 returned error can't find the container with id 75f74722a247e105c3f3a47fbaf73118ad4a04a829177e163458fc6fb3779a7b Jul 13 03:42:15.414519 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:15.414480 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jllf"] Jul 13 03:42:15.416953 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:15.416935 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5937711_ef4e_47e3_baf2_e1bed6c7e1c1.slice/crio-770f814f3d0f307c3ab419921eb0ce99a9291499e179905a214fa0c43364547b WatchSource:0}: Error finding container 770f814f3d0f307c3ab419921eb0ce99a9291499e179905a214fa0c43364547b: Status 404 returned error can't find the container with id 770f814f3d0f307c3ab419921eb0ce99a9291499e179905a214fa0c43364547b Jul 13 03:42:16.372570 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:16.372534 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x6ssv" event={"ID":"b000cdb6-c30f-4c00-9735-db852b13ec82","Type":"ContainerStarted","Data":"bedb59dfe616b122eca3c8bce32e5bc9132affc62be9939cd1ea4d5e45432df4"} Jul 13 03:42:16.373061 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:16.372608 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:42:16.373061 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:16.372633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x6ssv" event={"ID":"b000cdb6-c30f-4c00-9735-db852b13ec82","Type":"ContainerStarted","Data":"75f74722a247e105c3f3a47fbaf73118ad4a04a829177e163458fc6fb3779a7b"} Jul 13 03:42:16.374387 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:16.374361 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jllf" event={"ID":"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1","Type":"ContainerStarted","Data":"770f814f3d0f307c3ab419921eb0ce99a9291499e179905a214fa0c43364547b"} Jul 13 03:42:16.388036 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:16.387995 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x6ssv" podStartSLOduration=66.387980659 podStartE2EDuration="1m6.387980659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:16.386398248 +0000 UTC m=+66.997425056" watchObservedRunningTime="2026-07-13 03:42:16.387980659 +0000 UTC m=+66.999007434" Jul 13 03:42:17.380069 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.379992 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jllf" event={"ID":"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1","Type":"ContainerStarted","Data":"0786d5f8095c28107a53b2171a8a4956a860f011f164e0edf973d9430c628547"} Jul 13 03:42:17.380069 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.380069 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jllf" event={"ID":"b5937711-ef4e-47e3-baf2-e1bed6c7e1c1","Type":"ContainerStarted","Data":"702e660ff4b11d71a5651b4cac0c4a944b7df5c8845cf3bb2c5542fafd63c3de"} Jul 13 03:42:17.397182 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.397124 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4jllf" podStartSLOduration=66.170330321 podStartE2EDuration="1m7.397105997s" totalImagesPullingTime="1.226775676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:17.395509046 +0000 UTC m=+68.006535846" watchObservedRunningTime="2026-07-13 03:42:17.397105997 +0000 UTC m=+68.008132793" Jul 13 03:42:17.568793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.568753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:42:17.568976 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.568813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:42:17.571258 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.571230 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"image-registry-7c5f7bbb6f-klcp8\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:42:17.571463 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.571441 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60db5188-05f4-41e4-a068-c6172faec175-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-xtm67\" (UID: \"60db5188-05f4-41e4-a068-c6172faec175\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:42:17.670124 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.670031 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:42:17.670124 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.670082 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:17.670124 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.670123 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:42:17.670386 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.670310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:17.670386 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.670375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:42:17.671166 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.671137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d08be5-f84e-45ef-8af3-be89af94bef4-service-ca-bundle\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:17.672941 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.672917 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2589615c-36ca-464a-871e-f69e74cfb2f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-x8v78\" (UID: \"2589615c-36ca-464a-871e-f69e74cfb2f7\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:42:17.673048 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.673030 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11807f63-2cb3-46cf-9b11-23b24265ab75-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rlgcr\" (UID: \"11807f63-2cb3-46cf-9b11-23b24265ab75\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:42:17.673102 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.673084 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d08be5-f84e-45ef-8af3-be89af94bef4-metrics-certs\") pod \"router-default-75849b74f4-57j5n\" (UID: \"c7d08be5-f84e-45ef-8af3-be89af94bef4\") " pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:17.673253 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.673230 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26698947-2633-48e2-b49c-26595c53eafd-metrics-tls\") pod \"dns-default-kw4gq\" (UID: \"26698947-2633-48e2-b49c-26595c53eafd\") " pod="openshift-dns/dns-default-kw4gq" Jul 13 03:42:17.811167 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.811138 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v8wj6\"" Jul 13 03:42:17.819112 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.819087 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" Jul 13 03:42:17.821222 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.821199 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qj9qk\"" Jul 13 03:42:17.830347 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.830303 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:42:17.853881 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.853857 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ssn6f\"" Jul 13 03:42:17.861758 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.861731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" Jul 13 03:42:17.879288 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.879259 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjttq\"" Jul 13 03:42:17.885468 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.885416 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q2xrs\"" Jul 13 03:42:17.887420 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.887255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kw4gq" Jul 13 03:42:17.890798 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.890752 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jq8qx\"" Jul 13 03:42:17.893562 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.893543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:17.899234 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.899205 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" Jul 13 03:42:17.951390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:17.951311 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67"] Jul 13 03:42:19.393939 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.393900 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" event={"ID":"60db5188-05f4-41e4-a068-c6172faec175","Type":"ContainerStarted","Data":"f4b87e2df703562645de1c174d4657772eecb378295f2ddf22efb7b27db9ea93"} Jul 13 03:42:19.458284 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.458191 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5f7bbb6f-klcp8"] Jul 13 03:42:19.481983 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.481952 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kw4gq"] Jul 13 03:42:19.509746 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.509723 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rlgcr"] Jul 13 03:42:19.624630 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:19.624553 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2301587_1e02_45b5_9660_b445e23c4c16.slice/crio-8c2759554e3ee6a808cc3565473cfbdfe23b89300d0f6b5428ee92977145f6a9 WatchSource:0}: Error finding container 8c2759554e3ee6a808cc3565473cfbdfe23b89300d0f6b5428ee92977145f6a9: Status 404 returned error can't find the container with id 8c2759554e3ee6a808cc3565473cfbdfe23b89300d0f6b5428ee92977145f6a9 Jul 13 03:42:19.625215 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:19.625087 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26698947_2633_48e2_b49c_26595c53eafd.slice/crio-fd65737eac8ebc70568cbfdd70b9d2cde49756eac535db76d02ce94a6a75f40f WatchSource:0}: Error finding container fd65737eac8ebc70568cbfdd70b9d2cde49756eac535db76d02ce94a6a75f40f: Status 404 returned error can't find the container with id fd65737eac8ebc70568cbfdd70b9d2cde49756eac535db76d02ce94a6a75f40f Jul 13 03:42:19.626050 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:19.626028 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11807f63_2cb3_46cf_9b11_23b24265ab75.slice/crio-896f92ba824ec2097b7f422e25e80bfc0bdd7b7af54e1754e80591a7b1510593 WatchSource:0}: Error finding container 896f92ba824ec2097b7f422e25e80bfc0bdd7b7af54e1754e80591a7b1510593: Status 404 returned error can't find the container with id 896f92ba824ec2097b7f422e25e80bfc0bdd7b7af54e1754e80591a7b1510593 Jul 13 03:42:19.707384 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.707360 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78"] Jul 13 03:42:19.710789 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:19.710723 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2589615c_36ca_464a_871e_f69e74cfb2f7.slice/crio-169357ff6940d79128d845b81a04b251aa60900c616474900c5e8ed3cc752e6e WatchSource:0}: Error finding container 169357ff6940d79128d845b81a04b251aa60900c616474900c5e8ed3cc752e6e: Status 404 returned error can't find the container with id 169357ff6940d79128d845b81a04b251aa60900c616474900c5e8ed3cc752e6e Jul 13 03:42:19.714025 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.713559 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75849b74f4-57j5n"] Jul 13 03:42:19.718097 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:19.718058 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d08be5_f84e_45ef_8af3_be89af94bef4.slice/crio-5423d39b1fac64952b18e5a673d164aac6425a69fd2371bce9910712dcb9fbde WatchSource:0}: Error finding container 5423d39b1fac64952b18e5a673d164aac6425a69fd2371bce9910712dcb9fbde: Status 404 returned error can't find the container with id 5423d39b1fac64952b18e5a673d164aac6425a69fd2371bce9910712dcb9fbde Jul 13 03:42:19.924629 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:19.924540 2566 scope.go:117] "RemoveContainer" containerID="af268547046d88dca4715effd9ece11d6b3dd7bb1efa12243ceee2acfcb753fd" Jul 13 03:42:20.400732 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.400626 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kw4gq" event={"ID":"26698947-2633-48e2-b49c-26595c53eafd","Type":"ContainerStarted","Data":"fd65737eac8ebc70568cbfdd70b9d2cde49756eac535db76d02ce94a6a75f40f"} Jul 13 03:42:20.402257 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.402182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" event={"ID":"2589615c-36ca-464a-871e-f69e74cfb2f7","Type":"ContainerStarted","Data":"169357ff6940d79128d845b81a04b251aa60900c616474900c5e8ed3cc752e6e"} Jul 13 03:42:20.404919 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.404086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" event={"ID":"b2301587-1e02-45b5-9660-b445e23c4c16","Type":"ContainerStarted","Data":"6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56"} Jul 13 03:42:20.404919 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.404125 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" event={"ID":"b2301587-1e02-45b5-9660-b445e23c4c16","Type":"ContainerStarted","Data":"8c2759554e3ee6a808cc3565473cfbdfe23b89300d0f6b5428ee92977145f6a9"} Jul 13 03:42:20.404919 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.404856 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:42:20.407511 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.407400 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:42:20.407511 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.407495 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ls5tw" event={"ID":"1678db10-807b-4022-a8a5-23156692eb49","Type":"ContainerStarted","Data":"e8666458ad9ba85bf037cfd6969bfb89cbcc69f3483d0e479c882047946a49c6"} Jul 13 03:42:20.408243 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.408190 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:42:20.410675 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.410651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxgxc" event={"ID":"a9b72b47-ed1e-466e-bafb-9069b5d4e30a","Type":"ContainerStarted","Data":"662120941e67d8324c987a40ea3e85dedd1cfee780c3b0396442ce7348b37ff0"} Jul 13 03:42:20.412357 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.412332 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" event={"ID":"11807f63-2cb3-46cf-9b11-23b24265ab75","Type":"ContainerStarted","Data":"896f92ba824ec2097b7f422e25e80bfc0bdd7b7af54e1754e80591a7b1510593"} Jul 13 03:42:20.414206 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.414184 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75849b74f4-57j5n" event={"ID":"c7d08be5-f84e-45ef-8af3-be89af94bef4","Type":"ContainerStarted","Data":"48b4d6bb47f0c4e99c64b0e39e55933d8430eeb01f02234d6eebfacb0aae60e5"} Jul 13 03:42:20.414314 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.414223 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75849b74f4-57j5n" event={"ID":"c7d08be5-f84e-45ef-8af3-be89af94bef4","Type":"ContainerStarted","Data":"5423d39b1fac64952b18e5a673d164aac6425a69fd2371bce9910712dcb9fbde"} Jul 13 03:42:20.427277 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.427005 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" podStartSLOduration=69.426987264 podStartE2EDuration="1m9.426987264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:20.42522472 +0000 UTC m=+71.036251519" watchObservedRunningTime="2026-07-13 03:42:20.426987264 +0000 UTC m=+71.038014062" Jul 13 03:42:20.447570 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.447458 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-ls5tw" podStartSLOduration=43.3713329 podStartE2EDuration="52.447441659s" totalImagesPullingTime="9.076108759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:20.447419247 +0000 UTC m=+71.058446055" watchObservedRunningTime="2026-07-13 03:42:20.447441659 +0000 UTC m=+71.058468455" Jul 13 03:42:20.465570 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.464721 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rxgxc" podStartSLOduration=65.995138667 podStartE2EDuration="1m10.464702015s" totalImagesPullingTime="4.469563348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:20.464165594 +0000 UTC m=+71.075192392" watchObservedRunningTime="2026-07-13 03:42:20.464702015 +0000 UTC m=+71.075728813" Jul 13 03:42:20.484236 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.484182 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75849b74f4-57j5n" podStartSLOduration=51.484166131 podStartE2EDuration="51.484166131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:20.482959079 +0000 UTC m=+71.093985878" watchObservedRunningTime="2026-07-13 03:42:20.484166131 +0000 UTC m=+71.095192929" Jul 13 03:42:20.894088 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.894053 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:20.897106 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:20.897080 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:21.408577 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:21.408522 2566 patch_prober.go:28] interesting pod/console-operator-7866497494-ls5tw container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": context deadline exceeded" start-of-body= Jul 13 03:42:21.408995 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:21.408601 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-ls5tw" podUID="1678db10-807b-4022-a8a5-23156692eb49" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": context deadline exceeded" Jul 13 03:42:21.419250 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:21.419221 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:21.420500 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:21.420450 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75849b74f4-57j5n" Jul 13 03:42:21.667014 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:21.666926 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-ls5tw" Jul 13 03:42:22.286106 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.286075 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc"] Jul 13 03:42:22.315611 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.315573 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc"] Jul 13 03:42:22.315791 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.315669 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.318393 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.318367 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 03:42:22.319270 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.319244 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 03:42:22.319389 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.319359 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 03:42:22.319471 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.319458 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xmffs\"" Jul 13 03:42:22.319541 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.319474 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 03:42:22.416202 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.416164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/462f6cfd-f507-410d-b5ea-69b99d06fa08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d8979b77d-vc7pc\" (UID: \"462f6cfd-f507-410d-b5ea-69b99d06fa08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.416697 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.416242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2v9h\" (UniqueName: \"kubernetes.io/projected/462f6cfd-f507-410d-b5ea-69b99d06fa08-kube-api-access-r2v9h\") pod \"managed-serviceaccount-addon-agent-d8979b77d-vc7pc\" (UID: \"462f6cfd-f507-410d-b5ea-69b99d06fa08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.516857 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.516823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/462f6cfd-f507-410d-b5ea-69b99d06fa08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d8979b77d-vc7pc\" (UID: \"462f6cfd-f507-410d-b5ea-69b99d06fa08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.517031 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.516955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2v9h\" (UniqueName: \"kubernetes.io/projected/462f6cfd-f507-410d-b5ea-69b99d06fa08-kube-api-access-r2v9h\") pod \"managed-serviceaccount-addon-agent-d8979b77d-vc7pc\" (UID: \"462f6cfd-f507-410d-b5ea-69b99d06fa08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.519346 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.519314 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/462f6cfd-f507-410d-b5ea-69b99d06fa08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d8979b77d-vc7pc\" (UID: \"462f6cfd-f507-410d-b5ea-69b99d06fa08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.527261 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.527239 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2v9h\" (UniqueName: \"kubernetes.io/projected/462f6cfd-f507-410d-b5ea-69b99d06fa08-kube-api-access-r2v9h\") pod \"managed-serviceaccount-addon-agent-d8979b77d-vc7pc\" (UID: \"462f6cfd-f507-410d-b5ea-69b99d06fa08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:22.634976 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:22.634949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" Jul 13 03:42:23.737144 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:23.737119 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc"] Jul 13 03:42:23.750464 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:23.750440 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod462f6cfd_f507_410d_b5ea_69b99d06fa08.slice/crio-a18fd6b61ef7e7560cea0706cbb9bf5773ebee4455d2b268f7f35250b68024e6 WatchSource:0}: Error finding container a18fd6b61ef7e7560cea0706cbb9bf5773ebee4455d2b268f7f35250b68024e6: Status 404 returned error can't find the container with id a18fd6b61ef7e7560cea0706cbb9bf5773ebee4455d2b268f7f35250b68024e6 Jul 13 03:42:24.213039 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.212969 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m"] Jul 13 03:42:24.235339 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.235313 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m"] Jul 13 03:42:24.235513 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.235406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:24.237639 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.237589 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 03:42:24.237929 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.237913 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xb5sc\"" Jul 13 03:42:24.333342 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.333309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82cca265-b128-4084-a9fa-18c4998b9a71-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jtk2m\" (UID: \"82cca265-b128-4084-a9fa-18c4998b9a71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:24.430705 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.430667 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" event={"ID":"60db5188-05f4-41e4-a068-c6172faec175","Type":"ContainerStarted","Data":"db13948b7cdc9f4ad4b5ab436ecce1aa0c77572aeb669f08d678d2b15f5b71f8"} Jul 13 03:42:24.430878 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.430727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" event={"ID":"60db5188-05f4-41e4-a068-c6172faec175","Type":"ContainerStarted","Data":"63230fd593cac2a9ad5ad89ac199610e91a9664af703bb790d8097f9c4363721"} Jul 13 03:42:24.432163 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.432137 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" event={"ID":"11807f63-2cb3-46cf-9b11-23b24265ab75","Type":"ContainerStarted","Data":"2471e4ab0123563d3ee4df33072195071d4a9c0916ca7f35054de3a12ebb44c0"} Jul 13 03:42:24.433205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.433183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" event={"ID":"462f6cfd-f507-410d-b5ea-69b99d06fa08","Type":"ContainerStarted","Data":"a18fd6b61ef7e7560cea0706cbb9bf5773ebee4455d2b268f7f35250b68024e6"} Jul 13 03:42:24.433692 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.433673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82cca265-b128-4084-a9fa-18c4998b9a71-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jtk2m\" (UID: \"82cca265-b128-4084-a9fa-18c4998b9a71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:24.433826 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:24.433808 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 13 03:42:24.433889 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:24.433877 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82cca265-b128-4084-a9fa-18c4998b9a71-tls-certificates podName:82cca265-b128-4084-a9fa-18c4998b9a71 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:24.933846971 +0000 UTC m=+75.544873745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/82cca265-b128-4084-a9fa-18c4998b9a71-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-jtk2m" (UID: "82cca265-b128-4084-a9fa-18c4998b9a71") : secret "prometheus-operator-admission-webhook-tls" not found Jul 13 03:42:24.435009 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.434987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kw4gq" event={"ID":"26698947-2633-48e2-b49c-26595c53eafd","Type":"ContainerStarted","Data":"29ff016ab18cade73a013365708a6b5b266d6359fd8643b9d4b1cda1daecc3af"} Jul 13 03:42:24.435083 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.435033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kw4gq" event={"ID":"26698947-2633-48e2-b49c-26595c53eafd","Type":"ContainerStarted","Data":"b79b34d8a8ab14f706f22d602b202113e5d519bcd6bf91ad6377e05f23dd48d3"} Jul 13 03:42:24.435083 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.435060 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kw4gq" Jul 13 03:42:24.436545 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.436528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" event={"ID":"2589615c-36ca-464a-871e-f69e74cfb2f7","Type":"ContainerStarted","Data":"7683bcf7cd1e2b7c391ed4a11ed9dcd42b05f9487b533630656add7fd65bdc7b"} Jul 13 03:42:24.463948 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.463860 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-xtm67" podStartSLOduration=52.233008703 podStartE2EDuration="56.463845111s" totalImagesPullingTime="4.230836408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:24.463196837 +0000 UTC m=+75.074223672" watchObservedRunningTime="2026-07-13 03:42:24.463845111 +0000 UTC m=+75.074871909" Jul 13 03:42:24.481795 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.481724 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-rlgcr" podStartSLOduration=36.531219168 podStartE2EDuration="40.48170399s" totalImagesPullingTime="3.950484822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:24.481024216 +0000 UTC m=+75.092051014" watchObservedRunningTime="2026-07-13 03:42:24.48170399 +0000 UTC m=+75.092730787" Jul 13 03:42:24.499992 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.499939 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kw4gq" podStartSLOduration=35.550379844 podStartE2EDuration="39.49992382s" totalImagesPullingTime="3.949543976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:24.499162622 +0000 UTC m=+75.110189420" watchObservedRunningTime="2026-07-13 03:42:24.49992382 +0000 UTC m=+75.110950616" Jul 13 03:42:24.514829 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.514782 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-x8v78" podStartSLOduration=51.628563682 podStartE2EDuration="55.514754031s" totalImagesPullingTime="3.886190349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:24.513616848 +0000 UTC m=+75.124643646" watchObservedRunningTime="2026-07-13 03:42:24.514754031 +0000 UTC m=+75.125780827" Jul 13 03:42:24.937304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.937163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82cca265-b128-4084-a9fa-18c4998b9a71-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jtk2m\" (UID: \"82cca265-b128-4084-a9fa-18c4998b9a71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:24.940156 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:24.940127 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/82cca265-b128-4084-a9fa-18c4998b9a71-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jtk2m\" (UID: \"82cca265-b128-4084-a9fa-18c4998b9a71\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:25.143882 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:25.143840 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:25.316133 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:25.316108 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m"] Jul 13 03:42:25.319425 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:25.319392 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cca265_b128_4084_a9fa_18c4998b9a71.slice/crio-5c30545b71b4619d7a0c633aa0e14d4ba17dfe35dccbf7670258ee6e0fa8a90b WatchSource:0}: Error finding container 5c30545b71b4619d7a0c633aa0e14d4ba17dfe35dccbf7670258ee6e0fa8a90b: Status 404 returned error can't find the container with id 5c30545b71b4619d7a0c633aa0e14d4ba17dfe35dccbf7670258ee6e0fa8a90b Jul 13 03:42:25.442598 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:25.442523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" event={"ID":"82cca265-b128-4084-a9fa-18c4998b9a71","Type":"ContainerStarted","Data":"5c30545b71b4619d7a0c633aa0e14d4ba17dfe35dccbf7670258ee6e0fa8a90b"} Jul 13 03:42:27.453878 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:27.453834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" event={"ID":"462f6cfd-f507-410d-b5ea-69b99d06fa08","Type":"ContainerStarted","Data":"b7e687ba5c0bed508a7b2404050f82078bc7c079d9897af79ae6b75eb2263adc"} Jul 13 03:42:27.468310 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:27.468251 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d8979b77d-vc7pc" podStartSLOduration=1.9760134539999998 podStartE2EDuration="5.468235598s" totalImagesPullingTime="3.492222144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:27.467986766 +0000 UTC m=+78.079013564" watchObservedRunningTime="2026-07-13 03:42:27.468235598 +0000 UTC m=+78.079262394" Jul 13 03:42:28.459100 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.459059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" event={"ID":"82cca265-b128-4084-a9fa-18c4998b9a71","Type":"ContainerStarted","Data":"48c360205b64dbdf5466217505a984184d59c43f5c56eb14d7e974b6d2f7aa36"} Jul 13 03:42:28.474647 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.474599 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" podStartSLOduration=2.011553713 podStartE2EDuration="4.47458396s" totalImagesPullingTime="2.463030247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:28.472744275 +0000 UTC m=+79.083771083" watchObservedRunningTime="2026-07-13 03:42:28.47458396 +0000 UTC m=+79.085610757" Jul 13 03:42:28.569602 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.569563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:28.571948 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.571919 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac11700e-0003-4782-8236-0f2462eb7203-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rd622\" (UID: \"ac11700e-0003-4782-8236-0f2462eb7203\") " pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:28.808113 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.808080 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5zfx\"" Jul 13 03:42:28.816070 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.816052 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rd622" Jul 13 03:42:28.944780 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:28.944749 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rd622"] Jul 13 03:42:28.947898 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:28.947866 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac11700e_0003_4782_8236_0f2462eb7203.slice/crio-8a2f4db79ef2ac262bbf582cb097dbd2942f1b04650b2e53102b66ce07426b7a WatchSource:0}: Error finding container 8a2f4db79ef2ac262bbf582cb097dbd2942f1b04650b2e53102b66ce07426b7a: Status 404 returned error can't find the container with id 8a2f4db79ef2ac262bbf582cb097dbd2942f1b04650b2e53102b66ce07426b7a Jul 13 03:42:29.465718 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:29.465634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rd622" event={"ID":"ac11700e-0003-4782-8236-0f2462eb7203","Type":"ContainerStarted","Data":"8a2f4db79ef2ac262bbf582cb097dbd2942f1b04650b2e53102b66ce07426b7a"} Jul 13 03:42:29.466133 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:29.465897 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:29.472089 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:29.472063 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jtk2m" Jul 13 03:42:33.483147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:33.483050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rd622" event={"ID":"ac11700e-0003-4782-8236-0f2462eb7203","Type":"ContainerStarted","Data":"2ce625b6f43caa84c9a5d6df61e5d8795a4638546c51539373b9d383fda31bbf"} Jul 13 03:42:33.483147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:33.483119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rd622" event={"ID":"ac11700e-0003-4782-8236-0f2462eb7203","Type":"ContainerStarted","Data":"7e2e84727f85afbce3ccebb1d4d98f96b362bc05791c0850a85a71b9f29bd191"} Jul 13 03:42:34.445204 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:34.445176 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kw4gq" Jul 13 03:42:36.495336 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:36.495298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rd622" event={"ID":"ac11700e-0003-4782-8236-0f2462eb7203","Type":"ContainerStarted","Data":"34bffc501a3f72886ad9df0e53aecbac280d5229c435b6d0cc923777b685d7ed"} Jul 13 03:42:36.512637 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:36.512593 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rd622" podStartSLOduration=34.019303047 podStartE2EDuration="40.512576799s" totalImagesPullingTime="6.493273752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:36.510373018 +0000 UTC m=+87.121399815" watchObservedRunningTime="2026-07-13 03:42:36.512576799 +0000 UTC m=+87.123603596" Jul 13 03:42:38.669814 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.669783 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gncrt"] Jul 13 03:42:38.672120 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.672101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.677751 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.677729 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 03:42:38.678337 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.678318 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 03:42:38.678439 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.678325 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 03:42:38.678523 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.678503 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 03:42:38.679268 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.679251 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pjmmw\"" Jul 13 03:42:38.858017 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.857977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-tls\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858183 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858183 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-wtmp\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858183 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-sys\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858183 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858127 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-root\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858183 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-metrics-client-ca\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858344 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858344 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858214 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhqxt\" (UniqueName: \"kubernetes.io/projected/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-kube-api-access-dhqxt\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.858344 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.858267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-textfile\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958710 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958614 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-textfile\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958710 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-tls\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-wtmp\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-sys\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-root\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-metrics-client-ca\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:38.958839 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958864 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhqxt\" (UniqueName: \"kubernetes.io/projected/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-kube-api-access-dhqxt\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.958931 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:42:38.958905 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-tls podName:ac4fed05-c85c-4de1-890d-a7c91dd2d1ba nodeName:}" failed. No retries permitted until 2026-07-13 03:42:39.458888481 +0000 UTC m=+90.069915256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-tls") pod "node-exporter-gncrt" (UID: "ac4fed05-c85c-4de1-890d-a7c91dd2d1ba") : secret "node-exporter-tls" not found Jul 13 03:42:38.959361 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.958996 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-textfile\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.959361 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.959072 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-root\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.959361 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.959208 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-wtmp\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.959361 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.959215 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-sys\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.959643 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.959620 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.959700 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.959651 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-metrics-client-ca\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.961006 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.960990 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:38.967053 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:38.967028 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhqxt\" (UniqueName: \"kubernetes.io/projected/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-kube-api-access-dhqxt\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:39.463518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:39.463462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-tls\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:39.465858 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:39.465825 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac4fed05-c85c-4de1-890d-a7c91dd2d1ba-node-exporter-tls\") pod \"node-exporter-gncrt\" (UID: \"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba\") " pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:39.582293 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:39.582257 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gncrt" Jul 13 03:42:39.594769 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:39.594738 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4fed05_c85c_4de1_890d_a7c91dd2d1ba.slice/crio-524f3fe48f0764d0add0825162a976080fad2b345e18d1349b8abe1e66ce8c4e WatchSource:0}: Error finding container 524f3fe48f0764d0add0825162a976080fad2b345e18d1349b8abe1e66ce8c4e: Status 404 returned error can't find the container with id 524f3fe48f0764d0add0825162a976080fad2b345e18d1349b8abe1e66ce8c4e Jul 13 03:42:40.510745 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:40.510693 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gncrt" event={"ID":"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba","Type":"ContainerStarted","Data":"524f3fe48f0764d0add0825162a976080fad2b345e18d1349b8abe1e66ce8c4e"} Jul 13 03:42:41.516154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:41.516119 2566 generic.go:356] "Generic (PLEG): container finished" podID="ac4fed05-c85c-4de1-890d-a7c91dd2d1ba" containerID="5d3c743ad72628c90a8e0652e31ab5e824a50383141b2dedb262b9b840eea3ee" exitCode=0 Jul 13 03:42:41.516535 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:41.516211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gncrt" event={"ID":"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba","Type":"ContainerDied","Data":"5d3c743ad72628c90a8e0652e31ab5e824a50383141b2dedb262b9b840eea3ee"} Jul 13 03:42:42.427877 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:42.427846 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:42:42.521970 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:42.521933 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gncrt" event={"ID":"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba","Type":"ContainerStarted","Data":"7def1ec57cf1f94e5c0dfebac91f1c209e5f0fc4b9ae7c4b10f13b413b86c50d"} Jul 13 03:42:42.522376 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:42.521992 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gncrt" event={"ID":"ac4fed05-c85c-4de1-890d-a7c91dd2d1ba","Type":"ContainerStarted","Data":"f9d7d3403496a3f526053899c93ed343002d8a55aad880bf33e208b19e83a77a"} Jul 13 03:42:42.539583 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:42.539539 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gncrt" podStartSLOduration=3.502411957 podStartE2EDuration="4.539523052s" totalImagesPullingTime="969.708869ms" totalInitContainerRuntime="67.402226ms" isStatefulPod=true podCreationTimestamp="2026-07-13 03:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:42.53823608 +0000 UTC m=+93.149262910" watchObservedRunningTime="2026-07-13 03:42:42.539523052 +0000 UTC m=+93.150549848" Jul 13 03:42:44.199496 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:44.199460 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5f7bbb6f-klcp8"] Jul 13 03:42:46.186858 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.186821 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689b5dd996-5v67j"] Jul 13 03:42:46.188964 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.188947 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.192726 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192612 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 03:42:46.192726 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192644 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 03:42:46.192726 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192667 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 03:42:46.192726 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192688 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 03:42:46.192726 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192698 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 03:42:46.193056 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192614 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6nlsh\"" Jul 13 03:42:46.193056 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192621 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 03:42:46.193056 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.192988 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 03:42:46.197219 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.197202 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 03:42:46.201602 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.201580 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689b5dd996-5v67j"] Jul 13 03:42:46.218430 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-console-config\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.218621 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-oauth-config\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.218621 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-service-ca\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.218621 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-serving-cert\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.218621 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb2bf\" (UniqueName: \"kubernetes.io/projected/0aa75ae3-529a-4e28-877c-66234095182a-kube-api-access-sb2bf\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.218792 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-trusted-ca-bundle\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.218792 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.218663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-oauth-serving-cert\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319193 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-console-config\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319353 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-oauth-config\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319353 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319252 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-service-ca\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319353 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-serving-cert\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319353 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb2bf\" (UniqueName: \"kubernetes.io/projected/0aa75ae3-529a-4e28-877c-66234095182a-kube-api-access-sb2bf\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319592 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-trusted-ca-bundle\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.319592 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.319438 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-oauth-serving-cert\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.320043 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.320013 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-console-config\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.320162 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.320070 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-service-ca\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.320162 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.320145 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-oauth-serving-cert\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.320871 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.320850 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-trusted-ca-bundle\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.322357 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.322332 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-serving-cert\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.322518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.322480 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-oauth-config\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.329460 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.329438 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb2bf\" (UniqueName: \"kubernetes.io/projected/0aa75ae3-529a-4e28-877c-66234095182a-kube-api-access-sb2bf\") pod \"console-689b5dd996-5v67j\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.499893 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.499816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:46.631120 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:46.631051 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689b5dd996-5v67j"] Jul 13 03:42:46.633928 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:42:46.633897 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa75ae3_529a_4e28_877c_66234095182a.slice/crio-a48a08a688f7c377b3d8f2a453ec15563257f25e1fc5d4bc22e732b62d7f422b WatchSource:0}: Error finding container a48a08a688f7c377b3d8f2a453ec15563257f25e1fc5d4bc22e732b62d7f422b: Status 404 returned error can't find the container with id a48a08a688f7c377b3d8f2a453ec15563257f25e1fc5d4bc22e732b62d7f422b Jul 13 03:42:47.383591 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:47.383561 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x6ssv" Jul 13 03:42:47.545293 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:47.545252 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b5dd996-5v67j" event={"ID":"0aa75ae3-529a-4e28-877c-66234095182a","Type":"ContainerStarted","Data":"a48a08a688f7c377b3d8f2a453ec15563257f25e1fc5d4bc22e732b62d7f422b"} Jul 13 03:42:50.560115 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:50.560079 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b5dd996-5v67j" event={"ID":"0aa75ae3-529a-4e28-877c-66234095182a","Type":"ContainerStarted","Data":"342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16"} Jul 13 03:42:50.577655 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:50.577607 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689b5dd996-5v67j" podStartSLOduration=1.412015274 podStartE2EDuration="4.577591774s" totalImagesPullingTime="3.1655765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:50.576271683 +0000 UTC m=+101.187298480" watchObservedRunningTime="2026-07-13 03:42:50.577591774 +0000 UTC m=+101.188618571" Jul 13 03:42:56.500254 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:56.500215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:56.500781 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:56.500546 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:56.505279 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:56.505257 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:42:56.585074 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:42:56.585045 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:43:01.600346 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:01.600314 2566 generic.go:356] "Generic (PLEG): container finished" podID="e85eb09d-160a-4f39-952d-8ec0b124ff6c" containerID="1073077de2ff73710d57daa4b241b176a6f2aa34092f7c6043931f67c6a4f3a3" exitCode=0 Jul 13 03:43:01.600864 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:01.600360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" event={"ID":"e85eb09d-160a-4f39-952d-8ec0b124ff6c","Type":"ContainerDied","Data":"1073077de2ff73710d57daa4b241b176a6f2aa34092f7c6043931f67c6a4f3a3"} Jul 13 03:43:01.600864 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:01.600792 2566 scope.go:117] "RemoveContainer" containerID="1073077de2ff73710d57daa4b241b176a6f2aa34092f7c6043931f67c6a4f3a3" Jul 13 03:43:02.413266 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:02.413232 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689b5dd996-5v67j"] Jul 13 03:43:02.605375 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:02.605340 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kpdwg" event={"ID":"e85eb09d-160a-4f39-952d-8ec0b124ff6c","Type":"ContainerStarted","Data":"a7ca346b2706c63b9b4f3284fd1182eb2efd8c439e5bbdbd02004cb0c7d171db"} Jul 13 03:43:09.219792 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.219742 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" podUID="b2301587-1e02-45b5-9660-b445e23c4c16" containerName="registry" containerID="cri-o://6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56" gracePeriod=30 Jul 13 03:43:09.486593 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.486570 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:43:09.618065 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618020 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-image-registry-private-configuration\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618065 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618070 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89blq\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-kube-api-access-89blq\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618095 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618115 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-trusted-ca\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618148 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-registry-certificates\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618190 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2301587-1e02-45b5-9660-b445e23c4c16-ca-trust-extracted\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618207 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-bound-sa-token\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618304 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618242 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-installation-pull-secrets\") pod \"b2301587-1e02-45b5-9660-b445e23c4c16\" (UID: \"b2301587-1e02-45b5-9660-b445e23c4c16\") " Jul 13 03:43:09.618688 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618656 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:43:09.618761 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.618728 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:43:09.620855 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.620816 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-kube-api-access-89blq" (OuterVolumeSpecName: "kube-api-access-89blq") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "kube-api-access-89blq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:43:09.621012 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.620931 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:43:09.621012 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.620994 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:43:09.621117 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.621062 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:43:09.621117 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.621097 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:43:09.629387 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.629351 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2301587-1e02-45b5-9660-b445e23c4c16-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b2301587-1e02-45b5-9660-b445e23c4c16" (UID: "b2301587-1e02-45b5-9660-b445e23c4c16"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:43:09.634637 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.634612 2566 generic.go:356] "Generic (PLEG): container finished" podID="b2301587-1e02-45b5-9660-b445e23c4c16" containerID="6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56" exitCode=0 Jul 13 03:43:09.634743 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.634658 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" Jul 13 03:43:09.634743 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.634686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" event={"ID":"b2301587-1e02-45b5-9660-b445e23c4c16","Type":"ContainerDied","Data":"6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56"} Jul 13 03:43:09.634743 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.634738 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5f7bbb6f-klcp8" event={"ID":"b2301587-1e02-45b5-9660-b445e23c4c16","Type":"ContainerDied","Data":"8c2759554e3ee6a808cc3565473cfbdfe23b89300d0f6b5428ee92977145f6a9"} Jul 13 03:43:09.634887 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.634757 2566 scope.go:117] "RemoveContainer" containerID="6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56" Jul 13 03:43:09.643133 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.643117 2566 scope.go:117] "RemoveContainer" containerID="6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56" Jul 13 03:43:09.643399 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:43:09.643370 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56\": container with ID starting with 6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56 not found: ID does not exist" containerID="6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56" Jul 13 03:43:09.643512 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.643407 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56"} err="failed to get container status \"6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56\": rpc error: code = NotFound desc = could not find container \"6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56\": container with ID starting with 6670c0bbf2cae36001b654cbc882bbf119247bda15edea75de7d39c705f21c56 not found: ID does not exist" Jul 13 03:43:09.656570 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.656521 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5f7bbb6f-klcp8"] Jul 13 03:43:09.659829 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.659805 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c5f7bbb6f-klcp8"] Jul 13 03:43:09.719398 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719359 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2301587-1e02-45b5-9660-b445e23c4c16-ca-trust-extracted\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719398 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719393 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-bound-sa-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719634 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719408 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-installation-pull-secrets\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719634 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719422 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2301587-1e02-45b5-9660-b445e23c4c16-image-registry-private-configuration\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719634 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719436 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89blq\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-kube-api-access-89blq\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719634 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719449 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2301587-1e02-45b5-9660-b445e23c4c16-registry-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719634 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719459 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-trusted-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.719634 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.719469 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2301587-1e02-45b5-9660-b445e23c4c16-registry-certificates\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:09.927753 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:09.927719 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2301587-1e02-45b5-9660-b445e23c4c16" path="/var/lib/kubelet/pods/b2301587-1e02-45b5-9660-b445e23c4c16/volumes" Jul 13 03:43:21.682203 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:21.682118 2566 generic.go:356] "Generic (PLEG): container finished" podID="b9d5eb82-345f-4b31-9dfc-a99144942c32" containerID="0ef186c0b08771a3003fb1f15f9535356125e36aea3b266803217b8648cbaf99" exitCode=0 Jul 13 03:43:21.682203 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:21.682192 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" event={"ID":"b9d5eb82-345f-4b31-9dfc-a99144942c32","Type":"ContainerDied","Data":"0ef186c0b08771a3003fb1f15f9535356125e36aea3b266803217b8648cbaf99"} Jul 13 03:43:21.682598 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:21.682566 2566 scope.go:117] "RemoveContainer" containerID="0ef186c0b08771a3003fb1f15f9535356125e36aea3b266803217b8648cbaf99" Jul 13 03:43:22.687969 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:22.687936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xpq6d" event={"ID":"b9d5eb82-345f-4b31-9dfc-a99144942c32","Type":"ContainerStarted","Data":"11f5e3e0f71703fa918169ea72520c2afea59d418bff40129ee99afd9e362099"} Jul 13 03:43:27.435949 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.435887 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-689b5dd996-5v67j" podUID="0aa75ae3-529a-4e28-877c-66234095182a" containerName="console" containerID="cri-o://342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16" gracePeriod=15 Jul 13 03:43:27.670960 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.670934 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:43:27.709343 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.709266 2566 generic.go:356] "Generic (PLEG): container finished" podID="0aa75ae3-529a-4e28-877c-66234095182a" containerID="342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16" exitCode=0 Jul 13 03:43:27.709343 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.709313 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b5dd996-5v67j" Jul 13 03:43:27.709537 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.709358 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b5dd996-5v67j" event={"ID":"0aa75ae3-529a-4e28-877c-66234095182a","Type":"ContainerDied","Data":"342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16"} Jul 13 03:43:27.709537 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.709401 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b5dd996-5v67j" event={"ID":"0aa75ae3-529a-4e28-877c-66234095182a","Type":"ContainerDied","Data":"a48a08a688f7c377b3d8f2a453ec15563257f25e1fc5d4bc22e732b62d7f422b"} Jul 13 03:43:27.709537 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.709428 2566 scope.go:117] "RemoveContainer" containerID="342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16" Jul 13 03:43:27.717771 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.717752 2566 scope.go:117] "RemoveContainer" containerID="342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16" Jul 13 03:43:27.718010 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:43:27.717985 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16\": container with ID starting with 342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16 not found: ID does not exist" containerID="342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16" Jul 13 03:43:27.718087 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.718019 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16"} err="failed to get container status \"342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16\": rpc error: code = NotFound desc = could not find container \"342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16\": container with ID starting with 342f6547dec6efbb5a6951a3744edb3c1e489cfbd288cbf243cfd4231661eb16 not found: ID does not exist" Jul 13 03:43:27.768899 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.768873 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-serving-cert\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769035 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.768947 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-console-config\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769035 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.768969 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-oauth-serving-cert\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769035 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.768988 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-oauth-config\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769035 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769006 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-service-ca\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769234 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769139 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb2bf\" (UniqueName: \"kubernetes.io/projected/0aa75ae3-529a-4e28-877c-66234095182a-kube-api-access-sb2bf\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769234 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769180 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-trusted-ca-bundle\") pod \"0aa75ae3-529a-4e28-877c-66234095182a\" (UID: \"0aa75ae3-529a-4e28-877c-66234095182a\") " Jul 13 03:43:27.769547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769403 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:43:27.769547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769426 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-console-config" (OuterVolumeSpecName: "console-config") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:43:27.769547 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769406 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-service-ca" (OuterVolumeSpecName: "service-ca") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:43:27.769810 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.769785 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:43:27.771155 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.771132 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:43:27.771271 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.771249 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa75ae3-529a-4e28-877c-66234095182a-kube-api-access-sb2bf" (OuterVolumeSpecName: "kube-api-access-sb2bf") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "kube-api-access-sb2bf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:43:27.771314 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.771280 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0aa75ae3-529a-4e28-877c-66234095182a" (UID: "0aa75ae3-529a-4e28-877c-66234095182a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:43:27.870739 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870699 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-serving-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:27.870739 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870731 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-console-config\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:27.870739 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870741 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-oauth-serving-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:27.870969 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870751 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aa75ae3-529a-4e28-877c-66234095182a-console-oauth-config\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:27.870969 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870760 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:27.870969 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870768 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb2bf\" (UniqueName: \"kubernetes.io/projected/0aa75ae3-529a-4e28-877c-66234095182a-kube-api-access-sb2bf\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:27.870969 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:27.870777 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa75ae3-529a-4e28-877c-66234095182a-trusted-ca-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:43:28.024520 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:28.024479 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689b5dd996-5v67j"] Jul 13 03:43:28.028185 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:28.028161 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689b5dd996-5v67j"] Jul 13 03:43:29.927205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:29.927162 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa75ae3-529a-4e28-877c-66234095182a" path="/var/lib/kubelet/pods/0aa75ae3-529a-4e28-877c-66234095182a/volumes" Jul 13 03:43:31.728065 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:31.728030 2566 generic.go:356] "Generic (PLEG): container finished" podID="fc207ea4-221c-4cc7-9172-ccb65cd7bed7" containerID="94da49496db467ba01157bc8322cae755296dcdb6f2d6da41791590e7cdb0bd1" exitCode=0 Jul 13 03:43:31.728435 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:31.728102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" event={"ID":"fc207ea4-221c-4cc7-9172-ccb65cd7bed7","Type":"ContainerDied","Data":"94da49496db467ba01157bc8322cae755296dcdb6f2d6da41791590e7cdb0bd1"} Jul 13 03:43:31.728435 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:31.728425 2566 scope.go:117] "RemoveContainer" containerID="94da49496db467ba01157bc8322cae755296dcdb6f2d6da41791590e7cdb0bd1" Jul 13 03:43:32.732980 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:43:32.732948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jr4xz" event={"ID":"fc207ea4-221c-4cc7-9172-ccb65cd7bed7","Type":"ContainerStarted","Data":"e3491ac116e701a0194d2fb140073da25727c0e4948d1ce914873cb5ca629bf6"} Jul 13 03:44:57.617247 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617195 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p"] Jul 13 03:44:57.617819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617635 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2301587-1e02-45b5-9660-b445e23c4c16" containerName="registry" Jul 13 03:44:57.617819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617654 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2301587-1e02-45b5-9660-b445e23c4c16" containerName="registry" Jul 13 03:44:57.617819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617696 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa75ae3-529a-4e28-877c-66234095182a" containerName="console" Jul 13 03:44:57.617819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617706 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa75ae3-529a-4e28-877c-66234095182a" containerName="console" Jul 13 03:44:57.617819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617804 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2301587-1e02-45b5-9660-b445e23c4c16" containerName="registry" Jul 13 03:44:57.617819 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.617817 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa75ae3-529a-4e28-877c-66234095182a" containerName="console" Jul 13 03:44:57.621081 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.621059 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.623623 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.623601 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 03:44:57.623706 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.623648 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mr4q8\"" Jul 13 03:44:57.623748 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.623706 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 03:44:57.628225 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.628184 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p"] Jul 13 03:44:57.759058 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.759029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.759240 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.759063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k279j\" (UniqueName: \"kubernetes.io/projected/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-kube-api-access-k279j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.759240 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.759161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.860092 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.860046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.860092 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.860087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k279j\" (UniqueName: \"kubernetes.io/projected/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-kube-api-access-k279j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.860326 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.860132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.860440 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.860423 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.860585 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.860564 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.868017 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.867951 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k279j\" (UniqueName: \"kubernetes.io/projected/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-kube-api-access-k279j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:57.932077 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:57.932044 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:44:58.061038 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:58.061009 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p"] Jul 13 03:44:58.064070 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:44:58.064044 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925bf3c4_53d8_4a58_baeb_4c01c6b27ff6.slice/crio-6c1b5d497359260a1ce9c09e2e448740673d2624ddbf1ff1f8b244661c4607eb WatchSource:0}: Error finding container 6c1b5d497359260a1ce9c09e2e448740673d2624ddbf1ff1f8b244661c4607eb: Status 404 returned error can't find the container with id 6c1b5d497359260a1ce9c09e2e448740673d2624ddbf1ff1f8b244661c4607eb Jul 13 03:44:59.061177 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:44:59.061135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" event={"ID":"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6","Type":"ContainerStarted","Data":"6c1b5d497359260a1ce9c09e2e448740673d2624ddbf1ff1f8b244661c4607eb"} Jul 13 03:45:06.091398 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:06.091363 2566 generic.go:356] "Generic (PLEG): container finished" podID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerID="0e035a2224c8b9a1df1c0b0e7082d4c390d33d58e1008870bb7b83b3a31d1abf" exitCode=0 Jul 13 03:45:06.091863 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:06.091435 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" event={"ID":"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6","Type":"ContainerDied","Data":"0e035a2224c8b9a1df1c0b0e7082d4c390d33d58e1008870bb7b83b3a31d1abf"} Jul 13 03:45:09.106463 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:09.106426 2566 generic.go:356] "Generic (PLEG): container finished" podID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerID="86438c0ec6b4b3c45c17cd16428cc04568b3aa376913932aa10d660d276fe0e7" exitCode=0 Jul 13 03:45:09.106845 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:09.106475 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" event={"ID":"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6","Type":"ContainerDied","Data":"86438c0ec6b4b3c45c17cd16428cc04568b3aa376913932aa10d660d276fe0e7"} Jul 13 03:45:17.149564 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:17.149525 2566 generic.go:356] "Generic (PLEG): container finished" podID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerID="719bdfd2121bb1429c8c5591a4946469c38456a65bb99531f0a2e0c0510d1dcf" exitCode=0 Jul 13 03:45:17.149975 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:17.149614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" event={"ID":"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6","Type":"ContainerDied","Data":"719bdfd2121bb1429c8c5591a4946469c38456a65bb99531f0a2e0c0510d1dcf"} Jul 13 03:45:18.278725 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.278698 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:45:18.326116 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.326089 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-util\") pod \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " Jul 13 03:45:18.326274 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.326136 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-bundle\") pod \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " Jul 13 03:45:18.326348 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.326287 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k279j\" (UniqueName: \"kubernetes.io/projected/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-kube-api-access-k279j\") pod \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\" (UID: \"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6\") " Jul 13 03:45:18.326891 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.326868 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-bundle" (OuterVolumeSpecName: "bundle") pod "925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" (UID: "925bf3c4-53d8-4a58-baeb-4c01c6b27ff6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:45:18.328870 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.328457 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-kube-api-access-k279j" (OuterVolumeSpecName: "kube-api-access-k279j") pod "925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" (UID: "925bf3c4-53d8-4a58-baeb-4c01c6b27ff6"). InnerVolumeSpecName "kube-api-access-k279j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:45:18.330265 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.330240 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-util" (OuterVolumeSpecName: "util") pod "925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" (UID: "925bf3c4-53d8-4a58-baeb-4c01c6b27ff6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:45:18.427679 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.427583 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:18.427679 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.427624 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:18.427679 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:18.427636 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k279j\" (UniqueName: \"kubernetes.io/projected/925bf3c4-53d8-4a58-baeb-4c01c6b27ff6-kube-api-access-k279j\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:19.159300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:19.159270 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" Jul 13 03:45:19.159459 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:19.159275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxc6p" event={"ID":"925bf3c4-53d8-4a58-baeb-4c01c6b27ff6","Type":"ContainerDied","Data":"6c1b5d497359260a1ce9c09e2e448740673d2624ddbf1ff1f8b244661c4607eb"} Jul 13 03:45:19.159459 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:19.159394 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c1b5d497359260a1ce9c09e2e448740673d2624ddbf1ff1f8b244661c4607eb" Jul 13 03:45:29.558225 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558187 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd"] Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558531 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="extract" Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558543 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="extract" Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558560 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="pull" Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558565 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="pull" Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558575 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="util" Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558581 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="util" Jul 13 03:45:29.558651 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.558630 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="925bf3c4-53d8-4a58-baeb-4c01c6b27ff6" containerName="extract" Jul 13 03:45:29.561935 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.561918 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.564380 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.564355 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 03:45:29.564503 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.564464 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mr4q8\"" Jul 13 03:45:29.565390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.565369 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 03:45:29.573116 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.573091 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd"] Jul 13 03:45:29.616521 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.616472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx86g\" (UniqueName: \"kubernetes.io/projected/e65dc194-ed5e-49c8-b332-68849437ab4e-kube-api-access-lx86g\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.616649 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.616556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.616649 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.616577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.717808 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.717774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx86g\" (UniqueName: \"kubernetes.io/projected/e65dc194-ed5e-49c8-b332-68849437ab4e-kube-api-access-lx86g\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.717977 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.717827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.717977 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.717847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.718171 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.718153 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.718235 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.718193 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.725209 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.725185 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx86g\" (UniqueName: \"kubernetes.io/projected/e65dc194-ed5e-49c8-b332-68849437ab4e-kube-api-access-lx86g\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:29.870440 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:29.870350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:30.005095 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:30.005073 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd"] Jul 13 03:45:30.007743 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:45:30.007709 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65dc194_ed5e_49c8_b332_68849437ab4e.slice/crio-f0d46f6da1c5ac68d6ca9a966a3f73111aacbd8792e7d63d533ff0ad77745f1c WatchSource:0}: Error finding container f0d46f6da1c5ac68d6ca9a966a3f73111aacbd8792e7d63d533ff0ad77745f1c: Status 404 returned error can't find the container with id f0d46f6da1c5ac68d6ca9a966a3f73111aacbd8792e7d63d533ff0ad77745f1c Jul 13 03:45:30.202175 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:30.201955 2566 generic.go:356] "Generic (PLEG): container finished" podID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerID="b84816e5460955f20451e4fcce946e54cb50f5e534742b54bef2241a5008474c" exitCode=0 Jul 13 03:45:30.202175 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:30.202101 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" event={"ID":"e65dc194-ed5e-49c8-b332-68849437ab4e","Type":"ContainerDied","Data":"b84816e5460955f20451e4fcce946e54cb50f5e534742b54bef2241a5008474c"} Jul 13 03:45:30.202175 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:30.202174 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" event={"ID":"e65dc194-ed5e-49c8-b332-68849437ab4e","Type":"ContainerStarted","Data":"f0d46f6da1c5ac68d6ca9a966a3f73111aacbd8792e7d63d533ff0ad77745f1c"} Jul 13 03:45:32.213401 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:32.213368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" event={"ID":"e65dc194-ed5e-49c8-b332-68849437ab4e","Type":"ContainerStarted","Data":"1e6d7eb9820048a03f81a8253ffa78807658002e813cd0ce4ae1bd27f5b9fd44"} Jul 13 03:45:33.219452 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:33.219414 2566 generic.go:356] "Generic (PLEG): container finished" podID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerID="1e6d7eb9820048a03f81a8253ffa78807658002e813cd0ce4ae1bd27f5b9fd44" exitCode=0 Jul 13 03:45:33.219452 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:33.219446 2566 generic.go:356] "Generic (PLEG): container finished" podID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerID="178fbe86904c15bdeeba871c4bc1781916601b45c968619f2bc28eca23936286" exitCode=0 Jul 13 03:45:33.219851 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:33.219503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" event={"ID":"e65dc194-ed5e-49c8-b332-68849437ab4e","Type":"ContainerDied","Data":"1e6d7eb9820048a03f81a8253ffa78807658002e813cd0ce4ae1bd27f5b9fd44"} Jul 13 03:45:33.219851 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:33.219584 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" event={"ID":"e65dc194-ed5e-49c8-b332-68849437ab4e","Type":"ContainerDied","Data":"178fbe86904c15bdeeba871c4bc1781916601b45c968619f2bc28eca23936286"} Jul 13 03:45:34.349410 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.349384 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:34.458553 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.458522 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-util\") pod \"e65dc194-ed5e-49c8-b332-68849437ab4e\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " Jul 13 03:45:34.458710 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.458600 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx86g\" (UniqueName: \"kubernetes.io/projected/e65dc194-ed5e-49c8-b332-68849437ab4e-kube-api-access-lx86g\") pod \"e65dc194-ed5e-49c8-b332-68849437ab4e\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " Jul 13 03:45:34.458710 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.458636 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-bundle\") pod \"e65dc194-ed5e-49c8-b332-68849437ab4e\" (UID: \"e65dc194-ed5e-49c8-b332-68849437ab4e\") " Jul 13 03:45:34.459044 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.459018 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-bundle" (OuterVolumeSpecName: "bundle") pod "e65dc194-ed5e-49c8-b332-68849437ab4e" (UID: "e65dc194-ed5e-49c8-b332-68849437ab4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:45:34.460745 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.460720 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65dc194-ed5e-49c8-b332-68849437ab4e-kube-api-access-lx86g" (OuterVolumeSpecName: "kube-api-access-lx86g") pod "e65dc194-ed5e-49c8-b332-68849437ab4e" (UID: "e65dc194-ed5e-49c8-b332-68849437ab4e"). InnerVolumeSpecName "kube-api-access-lx86g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:45:34.464292 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.464257 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-util" (OuterVolumeSpecName: "util") pod "e65dc194-ed5e-49c8-b332-68849437ab4e" (UID: "e65dc194-ed5e-49c8-b332-68849437ab4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:45:34.559277 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.559241 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx86g\" (UniqueName: \"kubernetes.io/projected/e65dc194-ed5e-49c8-b332-68849437ab4e-kube-api-access-lx86g\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:34.559277 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.559276 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:34.559462 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:34.559287 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e65dc194-ed5e-49c8-b332-68849437ab4e-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:35.229334 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:35.229304 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" Jul 13 03:45:35.229334 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:35.229320 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbhnkd" event={"ID":"e65dc194-ed5e-49c8-b332-68849437ab4e","Type":"ContainerDied","Data":"f0d46f6da1c5ac68d6ca9a966a3f73111aacbd8792e7d63d533ff0ad77745f1c"} Jul 13 03:45:35.229548 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:35.229364 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0d46f6da1c5ac68d6ca9a966a3f73111aacbd8792e7d63d533ff0ad77745f1c" Jul 13 03:45:37.647326 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647291 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s"] Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647605 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="pull" Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647618 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="pull" Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647633 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="util" Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647642 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="util" Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647651 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="extract" Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647656 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="extract" Jul 13 03:45:37.647793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.647710 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65dc194-ed5e-49c8-b332-68849437ab4e" containerName="extract" Jul 13 03:45:37.649551 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.649534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.652040 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.652018 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 03:45:37.652850 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.652832 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-274gg\"" Jul 13 03:45:37.652924 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.652862 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 03:45:37.657449 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.657422 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s"] Jul 13 03:45:37.785726 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.785684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7071b942-6327-4023-94f1-b345206454d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lmq7s\" (UID: \"7071b942-6327-4023-94f1-b345206454d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.785880 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.785740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85lxl\" (UniqueName: \"kubernetes.io/projected/7071b942-6327-4023-94f1-b345206454d7-kube-api-access-85lxl\") pod \"cert-manager-cainjector-559cdd8c87-lmq7s\" (UID: \"7071b942-6327-4023-94f1-b345206454d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.886671 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.886626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7071b942-6327-4023-94f1-b345206454d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lmq7s\" (UID: \"7071b942-6327-4023-94f1-b345206454d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.886853 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.886691 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85lxl\" (UniqueName: \"kubernetes.io/projected/7071b942-6327-4023-94f1-b345206454d7-kube-api-access-85lxl\") pod \"cert-manager-cainjector-559cdd8c87-lmq7s\" (UID: \"7071b942-6327-4023-94f1-b345206454d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.895368 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.895342 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7071b942-6327-4023-94f1-b345206454d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lmq7s\" (UID: \"7071b942-6327-4023-94f1-b345206454d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.895512 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.895395 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85lxl\" (UniqueName: \"kubernetes.io/projected/7071b942-6327-4023-94f1-b345206454d7-kube-api-access-85lxl\") pod \"cert-manager-cainjector-559cdd8c87-lmq7s\" (UID: \"7071b942-6327-4023-94f1-b345206454d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:37.959268 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:37.959193 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" Jul 13 03:45:38.101906 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:38.101872 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s"] Jul 13 03:45:38.105179 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:45:38.105144 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7071b942_6327_4023_94f1_b345206454d7.slice/crio-ee14c07db3b6131e7e5928ccbf75ec05e400ddfc82def6c50725ef2a3da4e23b WatchSource:0}: Error finding container ee14c07db3b6131e7e5928ccbf75ec05e400ddfc82def6c50725ef2a3da4e23b: Status 404 returned error can't find the container with id ee14c07db3b6131e7e5928ccbf75ec05e400ddfc82def6c50725ef2a3da4e23b Jul 13 03:45:38.242790 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:38.242707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" event={"ID":"7071b942-6327-4023-94f1-b345206454d7","Type":"ContainerStarted","Data":"ee14c07db3b6131e7e5928ccbf75ec05e400ddfc82def6c50725ef2a3da4e23b"} Jul 13 03:45:41.256070 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:41.256033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" event={"ID":"7071b942-6327-4023-94f1-b345206454d7","Type":"ContainerStarted","Data":"f646974ada7e9bab4f3e6df51f76345cb16b7c57e4a645c331e6f78858b04a6c"} Jul 13 03:45:41.273495 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:41.273437 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmq7s" podStartSLOduration=1.633905925 podStartE2EDuration="4.273421152s" totalImagesPullingTime="2.639515227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:45:41.271745644 +0000 UTC m=+271.882772438" watchObservedRunningTime="2026-07-13 03:45:41.273421152 +0000 UTC m=+271.884447949" Jul 13 03:45:50.361502 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.361452 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g"] Jul 13 03:45:50.401997 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.401958 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g"] Jul 13 03:45:50.402147 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.402071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.404740 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.404719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 03:45:50.404855 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.404719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 03:45:50.405690 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.405675 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mr4q8\"" Jul 13 03:45:50.491953 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.491918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.492099 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.491983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf2v8\" (UniqueName: \"kubernetes.io/projected/edd42442-fe84-4086-9cf8-a8c93efcd5c0-kube-api-access-rf2v8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.492099 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.492022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.592908 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.592867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf2v8\" (UniqueName: \"kubernetes.io/projected/edd42442-fe84-4086-9cf8-a8c93efcd5c0-kube-api-access-rf2v8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.593074 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.592912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.593074 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.592959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.593347 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.593325 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.593415 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.593367 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.600697 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.600675 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf2v8\" (UniqueName: \"kubernetes.io/projected/edd42442-fe84-4086-9cf8-a8c93efcd5c0-kube-api-access-rf2v8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.711747 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.711656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:50.854274 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:50.854149 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g"] Jul 13 03:45:50.856935 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:45:50.856904 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd42442_fe84_4086_9cf8_a8c93efcd5c0.slice/crio-e2d79d120789edcd2f1482df4feca271ea37f64ab4416d02bba06e94953ab2d6 WatchSource:0}: Error finding container e2d79d120789edcd2f1482df4feca271ea37f64ab4416d02bba06e94953ab2d6: Status 404 returned error can't find the container with id e2d79d120789edcd2f1482df4feca271ea37f64ab4416d02bba06e94953ab2d6 Jul 13 03:45:51.296325 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:51.296289 2566 generic.go:356] "Generic (PLEG): container finished" podID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerID="76c57bc91a083d6ba419bdf7d70b52b158e71bcc412fdbea063283bb57d9767f" exitCode=0 Jul 13 03:45:51.296509 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:51.296375 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" event={"ID":"edd42442-fe84-4086-9cf8-a8c93efcd5c0","Type":"ContainerDied","Data":"76c57bc91a083d6ba419bdf7d70b52b158e71bcc412fdbea063283bb57d9767f"} Jul 13 03:45:51.296509 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:51.296423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" event={"ID":"edd42442-fe84-4086-9cf8-a8c93efcd5c0","Type":"ContainerStarted","Data":"e2d79d120789edcd2f1482df4feca271ea37f64ab4416d02bba06e94953ab2d6"} Jul 13 03:45:52.305031 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:52.304999 2566 generic.go:356] "Generic (PLEG): container finished" podID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerID="b74f55ebabf5f10885b965ffe6320617b36dc2078b3c01fc3f2c3c7410843988" exitCode=0 Jul 13 03:45:52.305419 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:52.305068 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" event={"ID":"edd42442-fe84-4086-9cf8-a8c93efcd5c0","Type":"ContainerDied","Data":"b74f55ebabf5f10885b965ffe6320617b36dc2078b3c01fc3f2c3c7410843988"} Jul 13 03:45:53.311593 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:53.311560 2566 generic.go:356] "Generic (PLEG): container finished" podID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerID="7b41fe0b2f243e1d9a817ecb7c6128065e0dd056e5d0b384b5ff11e22173f568" exitCode=0 Jul 13 03:45:53.311975 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:53.311644 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" event={"ID":"edd42442-fe84-4086-9cf8-a8c93efcd5c0","Type":"ContainerDied","Data":"7b41fe0b2f243e1d9a817ecb7c6128065e0dd056e5d0b384b5ff11e22173f568"} Jul 13 03:45:54.444647 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.444620 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:54.625310 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.625218 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-bundle\") pod \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " Jul 13 03:45:54.625310 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.625262 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf2v8\" (UniqueName: \"kubernetes.io/projected/edd42442-fe84-4086-9cf8-a8c93efcd5c0-kube-api-access-rf2v8\") pod \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " Jul 13 03:45:54.625310 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.625310 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-util\") pod \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\" (UID: \"edd42442-fe84-4086-9cf8-a8c93efcd5c0\") " Jul 13 03:45:54.625971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.625944 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-bundle" (OuterVolumeSpecName: "bundle") pod "edd42442-fe84-4086-9cf8-a8c93efcd5c0" (UID: "edd42442-fe84-4086-9cf8-a8c93efcd5c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:45:54.627478 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.627449 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd42442-fe84-4086-9cf8-a8c93efcd5c0-kube-api-access-rf2v8" (OuterVolumeSpecName: "kube-api-access-rf2v8") pod "edd42442-fe84-4086-9cf8-a8c93efcd5c0" (UID: "edd42442-fe84-4086-9cf8-a8c93efcd5c0"). InnerVolumeSpecName "kube-api-access-rf2v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:45:54.631034 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.630998 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-util" (OuterVolumeSpecName: "util") pod "edd42442-fe84-4086-9cf8-a8c93efcd5c0" (UID: "edd42442-fe84-4086-9cf8-a8c93efcd5c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:45:54.726699 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.726662 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:54.726699 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.726697 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edd42442-fe84-4086-9cf8-a8c93efcd5c0-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:54.726699 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:54.726707 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf2v8\" (UniqueName: \"kubernetes.io/projected/edd42442-fe84-4086-9cf8-a8c93efcd5c0-kube-api-access-rf2v8\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:45:55.321631 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:55.321602 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" Jul 13 03:45:55.321800 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:55.321601 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdp46g" event={"ID":"edd42442-fe84-4086-9cf8-a8c93efcd5c0","Type":"ContainerDied","Data":"e2d79d120789edcd2f1482df4feca271ea37f64ab4416d02bba06e94953ab2d6"} Jul 13 03:45:55.321800 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:45:55.321723 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2d79d120789edcd2f1482df4feca271ea37f64ab4416d02bba06e94953ab2d6" Jul 13 03:46:02.155599 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155564 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg"] Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155848 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="util" Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155859 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="util" Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155866 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="pull" Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155873 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="pull" Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155885 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="extract" Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155891 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="extract" Jul 13 03:46:02.155974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.155944 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd42442-fe84-4086-9cf8-a8c93efcd5c0" containerName="extract" Jul 13 03:46:02.162098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.162076 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.164863 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.164834 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dz94k\"" Jul 13 03:46:02.165021 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.164871 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 03:46:02.165125 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.164876 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 03:46:02.165390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.165374 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 03:46:02.165479 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.165437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 03:46:02.173948 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.173929 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg"] Jul 13 03:46:02.291923 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.291888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be3ac418-6031-4a07-aa96-b42cf3982439-manifests\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.292086 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.291942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf8gp\" (UniqueName: \"kubernetes.io/projected/be3ac418-6031-4a07-aa96-b42cf3982439-kube-api-access-xf8gp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.292086 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.292054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be3ac418-6031-4a07-aa96-b42cf3982439-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.292170 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.292090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be3ac418-6031-4a07-aa96-b42cf3982439-tmp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.292170 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.292117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be3ac418-6031-4a07-aa96-b42cf3982439-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.392797 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.392763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf8gp\" (UniqueName: \"kubernetes.io/projected/be3ac418-6031-4a07-aa96-b42cf3982439-kube-api-access-xf8gp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.392997 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.392821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be3ac418-6031-4a07-aa96-b42cf3982439-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.392997 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.392841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be3ac418-6031-4a07-aa96-b42cf3982439-tmp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.392997 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.392865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be3ac418-6031-4a07-aa96-b42cf3982439-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.392997 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.392896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be3ac418-6031-4a07-aa96-b42cf3982439-manifests\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.393355 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.393326 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be3ac418-6031-4a07-aa96-b42cf3982439-manifests\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.395163 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.395136 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be3ac418-6031-4a07-aa96-b42cf3982439-tmp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.395362 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.395344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be3ac418-6031-4a07-aa96-b42cf3982439-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.395409 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.395370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be3ac418-6031-4a07-aa96-b42cf3982439-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.401177 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.401155 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf8gp\" (UniqueName: \"kubernetes.io/projected/be3ac418-6031-4a07-aa96-b42cf3982439-kube-api-access-xf8gp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-s45gg\" (UID: \"be3ac418-6031-4a07-aa96-b42cf3982439\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.473173 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.473083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:02.615085 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:02.614926 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg"] Jul 13 03:46:02.617935 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:46:02.617909 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3ac418_6031_4a07_aa96_b42cf3982439.slice/crio-0eac618ccba5337c8fce3b4de6c06851ebc2ec7c7403fb56b7bb4e87763b1fb3 WatchSource:0}: Error finding container 0eac618ccba5337c8fce3b4de6c06851ebc2ec7c7403fb56b7bb4e87763b1fb3: Status 404 returned error can't find the container with id 0eac618ccba5337c8fce3b4de6c06851ebc2ec7c7403fb56b7bb4e87763b1fb3 Jul 13 03:46:03.357435 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:03.357392 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" event={"ID":"be3ac418-6031-4a07-aa96-b42cf3982439","Type":"ContainerStarted","Data":"0eac618ccba5337c8fce3b4de6c06851ebc2ec7c7403fb56b7bb4e87763b1fb3"} Jul 13 03:46:06.374556 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:06.374467 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" event={"ID":"be3ac418-6031-4a07-aa96-b42cf3982439","Type":"ContainerStarted","Data":"4bfcf00855b71ee61a2c9475978671622bd22e00f69089956a986ae5bedb02d6"} Jul 13 03:46:07.380438 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:07.380377 2566 generic.go:356] "Generic (PLEG): container finished" podID="be3ac418-6031-4a07-aa96-b42cf3982439" containerID="4bfcf00855b71ee61a2c9475978671622bd22e00f69089956a986ae5bedb02d6" exitCode=0 Jul 13 03:46:07.380878 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:07.380466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" event={"ID":"be3ac418-6031-4a07-aa96-b42cf3982439","Type":"ContainerDied","Data":"4bfcf00855b71ee61a2c9475978671622bd22e00f69089956a986ae5bedb02d6"} Jul 13 03:46:08.386947 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:08.386914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" event={"ID":"be3ac418-6031-4a07-aa96-b42cf3982439","Type":"ContainerStarted","Data":"4144c0f6ac4df721651d0ffd26a847c98c5ed9df71917c576357b60871ca18e4"} Jul 13 03:46:08.387336 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:08.387048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:08.407528 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:08.407440 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" podStartSLOduration=1.984127796 podStartE2EDuration="6.407427715s" totalImagesPullingTime="3.370086042s" totalInitContainerRuntime="1.053213877s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:08.407139162 +0000 UTC m=+299.018165958" watchObservedRunningTime="2026-07-13 03:46:08.407427715 +0000 UTC m=+299.018454513" Jul 13 03:46:09.821326 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:09.821297 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:46:09.826702 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:09.826679 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:46:09.827647 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:09.827630 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:46:09.833270 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:09.833242 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 03:46:09.833379 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:09.833333 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:46:19.393614 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:19.393585 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-s45gg" Jul 13 03:46:21.397723 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.397685 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv"] Jul 13 03:46:21.401100 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.401078 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.403627 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.403600 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:46:21.403756 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.403647 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 03:46:21.405267 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.404987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 03:46:21.405267 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.405199 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9vkz4\"" Jul 13 03:46:21.405552 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.405370 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 03:46:21.405746 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.405721 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 03:46:21.412748 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.412717 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv"] Jul 13 03:46:21.449814 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.449783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85a0970a-3c09-4226-a153-166c801fc275-manager-config\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.449955 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.449822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9rw\" (UniqueName: \"kubernetes.io/projected/85a0970a-3c09-4226-a153-166c801fc275-kube-api-access-5r9rw\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.449955 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.449883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a0970a-3c09-4226-a153-166c801fc275-metrics-cert\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.449955 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.449907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85a0970a-3c09-4226-a153-166c801fc275-cert\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.550793 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.550756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85a0970a-3c09-4226-a153-166c801fc275-cert\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.550974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.550803 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85a0970a-3c09-4226-a153-166c801fc275-manager-config\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.550974 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.550877 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9rw\" (UniqueName: \"kubernetes.io/projected/85a0970a-3c09-4226-a153-166c801fc275-kube-api-access-5r9rw\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.551093 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.550973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a0970a-3c09-4226-a153-166c801fc275-metrics-cert\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.551388 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.551366 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85a0970a-3c09-4226-a153-166c801fc275-manager-config\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.553329 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.553308 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85a0970a-3c09-4226-a153-166c801fc275-cert\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.553506 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.553470 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85a0970a-3c09-4226-a153-166c801fc275-metrics-cert\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.564691 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.564666 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9rw\" (UniqueName: \"kubernetes.io/projected/85a0970a-3c09-4226-a153-166c801fc275-kube-api-access-5r9rw\") pod \"lws-controller-manager-6c9556dbfd-rhcnv\" (UID: \"85a0970a-3c09-4226-a153-166c801fc275\") " pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.715662 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.715577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:21.870878 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.870855 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv"] Jul 13 03:46:21.872965 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:46:21.872944 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a0970a_3c09_4226_a153_166c801fc275.slice/crio-dada2c7557ecd8b16ec04478ba45b98b88cc0b60522188b6fd2191aa33e3191d WatchSource:0}: Error finding container dada2c7557ecd8b16ec04478ba45b98b88cc0b60522188b6fd2191aa33e3191d: Status 404 returned error can't find the container with id dada2c7557ecd8b16ec04478ba45b98b88cc0b60522188b6fd2191aa33e3191d Jul 13 03:46:21.874896 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:21.874881 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:46:22.446888 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:22.446849 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" event={"ID":"85a0970a-3c09-4226-a153-166c801fc275","Type":"ContainerStarted","Data":"dada2c7557ecd8b16ec04478ba45b98b88cc0b60522188b6fd2191aa33e3191d"} Jul 13 03:46:23.452581 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:23.452543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" event={"ID":"85a0970a-3c09-4226-a153-166c801fc275","Type":"ContainerStarted","Data":"c85bfef8fce11a723d4bfee7c7b91340b2abb34bc56f7b7fac16cb57ce9a28c0"} Jul 13 03:46:23.452965 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:23.452699 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:23.467711 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:23.467667 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" podStartSLOduration=1.084879119 podStartE2EDuration="2.467651535s" totalImagesPullingTime="1.382772416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:23.466288686 +0000 UTC m=+314.077315496" watchObservedRunningTime="2026-07-13 03:46:23.467651535 +0000 UTC m=+314.078678331" Jul 13 03:46:28.933748 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.933711 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs"] Jul 13 03:46:28.937108 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.937090 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:28.939862 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.939842 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 03:46:28.939971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.939875 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 03:46:28.940118 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.940104 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 03:46:28.940194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.940110 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 03:46:28.940194 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.940127 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xbgf6\"" Jul 13 03:46:28.948808 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:28.948785 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs"] Jul 13 03:46:29.010615 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.010762 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwqgz\" (UniqueName: \"kubernetes.io/projected/feca5bba-fed8-4d9e-b1ea-4adc10113e35-kube-api-access-kwqgz\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.010762 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010656 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.010762 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.010762 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.010891 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.010891 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.010804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca5bba-fed8-4d9e-b1ea-4adc10113e35-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112183 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca5bba-fed8-4d9e-b1ea-4adc10113e35-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqgz\" (UniqueName: \"kubernetes.io/projected/feca5bba-fed8-4d9e-b1ea-4adc10113e35-kube-api-access-kwqgz\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.112971 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.112945 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.114611 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.114586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/feca5bba-fed8-4d9e-b1ea-4adc10113e35-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.114750 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.114719 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.115105 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.115083 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.115148 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.115092 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.119690 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.119663 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feca5bba-fed8-4d9e-b1ea-4adc10113e35-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.120445 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.120428 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwqgz\" (UniqueName: \"kubernetes.io/projected/feca5bba-fed8-4d9e-b1ea-4adc10113e35-kube-api-access-kwqgz\") pod \"istiod-openshift-gateway-94bb8fbfd-8hmgs\" (UID: \"feca5bba-fed8-4d9e-b1ea-4adc10113e35\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.246852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.246753 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:29.385812 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.385777 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs"] Jul 13 03:46:29.390272 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:46:29.390246 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeca5bba_fed8_4d9e_b1ea_4adc10113e35.slice/crio-aea79294a19522009bd774beb00c9eb3ed2f493aeaaf64154f2d63cc7d049798 WatchSource:0}: Error finding container aea79294a19522009bd774beb00c9eb3ed2f493aeaaf64154f2d63cc7d049798: Status 404 returned error can't find the container with id aea79294a19522009bd774beb00c9eb3ed2f493aeaaf64154f2d63cc7d049798 Jul 13 03:46:29.480921 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:29.480886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" event={"ID":"feca5bba-fed8-4d9e-b1ea-4adc10113e35","Type":"ContainerStarted","Data":"aea79294a19522009bd774beb00c9eb3ed2f493aeaaf64154f2d63cc7d049798"} Jul 13 03:46:32.897049 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:32.897004 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 13 03:46:32.897330 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:32.897080 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 13 03:46:33.503554 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:33.503510 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" event={"ID":"feca5bba-fed8-4d9e-b1ea-4adc10113e35","Type":"ContainerStarted","Data":"d2728fee6483e5d1f9e88bc9acd63b966d364d20cd0a3d7e2a162fc51cf589c2"} Jul 13 03:46:33.503797 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:33.503707 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:46:33.505527 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:33.505500 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-8hmgs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 03:46:33.505656 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:33.505557 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" podUID="feca5bba-fed8-4d9e-b1ea-4adc10113e35" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 03:46:33.552730 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:33.552681 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" podStartSLOduration=2.048191588 podStartE2EDuration="5.552658962s" totalImagesPullingTime="3.504467374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:33.549836606 +0000 UTC m=+324.160863403" watchObservedRunningTime="2026-07-13 03:46:33.552658962 +0000 UTC m=+324.163685760" Jul 13 03:46:34.458882 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:34.458851 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c9556dbfd-rhcnv" Jul 13 03:46:34.508367 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:46:34.508340 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8hmgs" Jul 13 03:47:37.949745 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:37.949715 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp"] Jul 13 03:47:37.952670 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:37.952653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:37.954914 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:37.954885 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 03:47:37.955022 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:37.954925 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 03:47:37.955876 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:37.955860 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s9h8z\"" Jul 13 03:47:37.960668 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:37.960638 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp"] Jul 13 03:47:38.079501 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.079445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.079677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.079511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.079677 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.079547 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npb9m\" (UniqueName: \"kubernetes.io/projected/0ca0bcaa-ce66-45af-b007-72518c14b7ea-kube-api-access-npb9m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.181027 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.180997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.181211 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.181038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.181211 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.181071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npb9m\" (UniqueName: \"kubernetes.io/projected/0ca0bcaa-ce66-45af-b007-72518c14b7ea-kube-api-access-npb9m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.181435 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.181406 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.181577 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.181456 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.189394 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.189371 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npb9m\" (UniqueName: \"kubernetes.io/projected/0ca0bcaa-ce66-45af-b007-72518c14b7ea-kube-api-access-npb9m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.263191 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.263165 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:38.373790 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.373747 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf"] Jul 13 03:47:38.382997 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.382963 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.383150 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.383060 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf"] Jul 13 03:47:38.395383 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.395356 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp"] Jul 13 03:47:38.399194 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:47:38.399173 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca0bcaa_ce66_45af_b007_72518c14b7ea.slice/crio-3b5d7f54c46fbdd59e8d64925ea90559fd42830dd0c331379b7cdb957f79ebd0 WatchSource:0}: Error finding container 3b5d7f54c46fbdd59e8d64925ea90559fd42830dd0c331379b7cdb957f79ebd0: Status 404 returned error can't find the container with id 3b5d7f54c46fbdd59e8d64925ea90559fd42830dd0c331379b7cdb957f79ebd0 Jul 13 03:47:38.483024 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.482997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.483170 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.483079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pttvq\" (UniqueName: \"kubernetes.io/projected/1a77d927-b889-4307-be07-a2fe0bf2d9e0-kube-api-access-pttvq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.483170 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.483107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.583509 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.583428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.583509 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.583469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.583660 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.583619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pttvq\" (UniqueName: \"kubernetes.io/projected/1a77d927-b889-4307-be07-a2fe0bf2d9e0-kube-api-access-pttvq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.583878 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.583857 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.583938 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.583879 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.591954 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.591927 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pttvq\" (UniqueName: \"kubernetes.io/projected/1a77d927-b889-4307-be07-a2fe0bf2d9e0-kube-api-access-pttvq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.692946 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.692917 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:38.793930 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.793893 2566 generic.go:356] "Generic (PLEG): container finished" podID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerID="33c2f61e4dde9291de3367fdf33f6314f9abe18ea6d4d08a70bffd1174169b66" exitCode=0 Jul 13 03:47:38.794106 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.793980 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" event={"ID":"0ca0bcaa-ce66-45af-b007-72518c14b7ea","Type":"ContainerDied","Data":"33c2f61e4dde9291de3367fdf33f6314f9abe18ea6d4d08a70bffd1174169b66"} Jul 13 03:47:38.794106 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.794048 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" event={"ID":"0ca0bcaa-ce66-45af-b007-72518c14b7ea","Type":"ContainerStarted","Data":"3b5d7f54c46fbdd59e8d64925ea90559fd42830dd0c331379b7cdb957f79ebd0"} Jul 13 03:47:38.824656 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.824630 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf"] Jul 13 03:47:38.826834 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:47:38.826813 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a77d927_b889_4307_be07_a2fe0bf2d9e0.slice/crio-c7a51c03b145fa593eb1cff5651f92468035842f13a53d03350cb69abd2f5014 WatchSource:0}: Error finding container c7a51c03b145fa593eb1cff5651f92468035842f13a53d03350cb69abd2f5014: Status 404 returned error can't find the container with id c7a51c03b145fa593eb1cff5651f92468035842f13a53d03350cb69abd2f5014 Jul 13 03:47:38.946390 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.946361 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7"] Jul 13 03:47:38.949738 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.949717 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:38.957343 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:38.957322 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7"] Jul 13 03:47:39.088172 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.088129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.088357 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.088182 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2zp4\" (UniqueName: \"kubernetes.io/projected/a59541cc-a42c-469d-ba21-f07624fe8466-kube-api-access-k2zp4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.088357 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.088236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.189693 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.189610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.189693 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.189671 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.189912 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.189701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2zp4\" (UniqueName: \"kubernetes.io/projected/a59541cc-a42c-469d-ba21-f07624fe8466-kube-api-access-k2zp4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.190079 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.190052 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.190135 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.190079 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.198253 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.198223 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2zp4\" (UniqueName: \"kubernetes.io/projected/a59541cc-a42c-469d-ba21-f07624fe8466-kube-api-access-k2zp4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.296689 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.296652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:39.422820 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.422793 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7"] Jul 13 03:47:39.424767 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:47:39.424740 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59541cc_a42c_469d_ba21_f07624fe8466.slice/crio-1bcb6f8f45dc5694104848a5c348aa065bb5055c69d811412a4e5be411424d83 WatchSource:0}: Error finding container 1bcb6f8f45dc5694104848a5c348aa065bb5055c69d811412a4e5be411424d83: Status 404 returned error can't find the container with id 1bcb6f8f45dc5694104848a5c348aa065bb5055c69d811412a4e5be411424d83 Jul 13 03:47:39.548949 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.548921 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt"] Jul 13 03:47:39.552541 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.552522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.562577 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.562554 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt"] Jul 13 03:47:39.593797 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.593775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxhdg\" (UniqueName: \"kubernetes.io/projected/5e309cb0-9eab-4b21-8611-9e35ff27907d-kube-api-access-dxhdg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.593912 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.593819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.593912 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.593846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.694568 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.694475 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.694687 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.694573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxhdg\" (UniqueName: \"kubernetes.io/projected/5e309cb0-9eab-4b21-8611-9e35ff27907d-kube-api-access-dxhdg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.694687 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.694620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.694852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.694832 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.694944 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.694925 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.706453 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.706433 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxhdg\" (UniqueName: \"kubernetes.io/projected/5e309cb0-9eab-4b21-8611-9e35ff27907d-kube-api-access-dxhdg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:39.800722 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.800689 2566 generic.go:356] "Generic (PLEG): container finished" podID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerID="b9c5c58f2b47e61569ef745c555ecf25f4c805e76678623e8332246c17e5a490" exitCode=0 Jul 13 03:47:39.800872 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.800774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" event={"ID":"0ca0bcaa-ce66-45af-b007-72518c14b7ea","Type":"ContainerDied","Data":"b9c5c58f2b47e61569ef745c555ecf25f4c805e76678623e8332246c17e5a490"} Jul 13 03:47:39.802305 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.802215 2566 generic.go:356] "Generic (PLEG): container finished" podID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerID="4dea13ee6c8ec11f3b3659c9632726243ca73a652ad132f09944feeae0bb219f" exitCode=0 Jul 13 03:47:39.802305 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.802284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" event={"ID":"1a77d927-b889-4307-be07-a2fe0bf2d9e0","Type":"ContainerDied","Data":"4dea13ee6c8ec11f3b3659c9632726243ca73a652ad132f09944feeae0bb219f"} Jul 13 03:47:39.802408 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.802326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" event={"ID":"1a77d927-b889-4307-be07-a2fe0bf2d9e0","Type":"ContainerStarted","Data":"c7a51c03b145fa593eb1cff5651f92468035842f13a53d03350cb69abd2f5014"} Jul 13 03:47:39.803915 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.803896 2566 generic.go:356] "Generic (PLEG): container finished" podID="a59541cc-a42c-469d-ba21-f07624fe8466" containerID="29f8b88b2ff3b6dc27cc72318881c3dbdad14f2780ee398e1d29709de135eccb" exitCode=0 Jul 13 03:47:39.803989 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.803922 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" event={"ID":"a59541cc-a42c-469d-ba21-f07624fe8466","Type":"ContainerDied","Data":"29f8b88b2ff3b6dc27cc72318881c3dbdad14f2780ee398e1d29709de135eccb"} Jul 13 03:47:39.803989 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.803974 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" event={"ID":"a59541cc-a42c-469d-ba21-f07624fe8466","Type":"ContainerStarted","Data":"1bcb6f8f45dc5694104848a5c348aa065bb5055c69d811412a4e5be411424d83"} Jul 13 03:47:39.889822 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:39.889790 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:40.023607 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.023585 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt"] Jul 13 03:47:40.025517 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:47:40.025463 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e309cb0_9eab_4b21_8611_9e35ff27907d.slice/crio-ff6ba4730833b9a02770fd83801e3f69035afb4872d95e745cda18c162ea75ec WatchSource:0}: Error finding container ff6ba4730833b9a02770fd83801e3f69035afb4872d95e745cda18c162ea75ec: Status 404 returned error can't find the container with id ff6ba4730833b9a02770fd83801e3f69035afb4872d95e745cda18c162ea75ec Jul 13 03:47:40.815668 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.815625 2566 generic.go:356] "Generic (PLEG): container finished" podID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerID="e1e68287f21b513a2aa8359bab577dbadab4bb3ae1ef0ee175911d7ade7e9b9a" exitCode=0 Jul 13 03:47:40.815840 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.815725 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" event={"ID":"0ca0bcaa-ce66-45af-b007-72518c14b7ea","Type":"ContainerDied","Data":"e1e68287f21b513a2aa8359bab577dbadab4bb3ae1ef0ee175911d7ade7e9b9a"} Jul 13 03:47:40.818186 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.818154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" event={"ID":"1a77d927-b889-4307-be07-a2fe0bf2d9e0","Type":"ContainerStarted","Data":"e52ac99726fd437c19053f703c59dbacb6e1b8e78ad656f59d098b6d0811e82e"} Jul 13 03:47:40.820506 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.820460 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" event={"ID":"a59541cc-a42c-469d-ba21-f07624fe8466","Type":"ContainerStarted","Data":"3eb490052782bea64ef65171bec54b9d1d03e8721dee12d6919972d1490675a6"} Jul 13 03:47:40.822151 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.822059 2566 generic.go:356] "Generic (PLEG): container finished" podID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerID="09d44d61a77287185654540f2e9e16149dd596cf46f5b7f726b4b5b27ec07f64" exitCode=0 Jul 13 03:47:40.822151 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.822122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" event={"ID":"5e309cb0-9eab-4b21-8611-9e35ff27907d","Type":"ContainerDied","Data":"09d44d61a77287185654540f2e9e16149dd596cf46f5b7f726b4b5b27ec07f64"} Jul 13 03:47:40.822276 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:40.822156 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" event={"ID":"5e309cb0-9eab-4b21-8611-9e35ff27907d","Type":"ContainerStarted","Data":"ff6ba4730833b9a02770fd83801e3f69035afb4872d95e745cda18c162ea75ec"} Jul 13 03:47:41.828731 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.828703 2566 generic.go:356] "Generic (PLEG): container finished" podID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerID="e52ac99726fd437c19053f703c59dbacb6e1b8e78ad656f59d098b6d0811e82e" exitCode=0 Jul 13 03:47:41.829068 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.828789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" event={"ID":"1a77d927-b889-4307-be07-a2fe0bf2d9e0","Type":"ContainerDied","Data":"e52ac99726fd437c19053f703c59dbacb6e1b8e78ad656f59d098b6d0811e82e"} Jul 13 03:47:41.830646 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.830625 2566 generic.go:356] "Generic (PLEG): container finished" podID="a59541cc-a42c-469d-ba21-f07624fe8466" containerID="3eb490052782bea64ef65171bec54b9d1d03e8721dee12d6919972d1490675a6" exitCode=0 Jul 13 03:47:41.830752 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.830725 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" event={"ID":"a59541cc-a42c-469d-ba21-f07624fe8466","Type":"ContainerDied","Data":"3eb490052782bea64ef65171bec54b9d1d03e8721dee12d6919972d1490675a6"} Jul 13 03:47:41.832640 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.832616 2566 generic.go:356] "Generic (PLEG): container finished" podID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerID="210ceb798d58e4a4416aa1b2c18870035bec2a0f33a0f9f4fb0adce3b87f9e73" exitCode=0 Jul 13 03:47:41.832728 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.832703 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" event={"ID":"5e309cb0-9eab-4b21-8611-9e35ff27907d","Type":"ContainerDied","Data":"210ceb798d58e4a4416aa1b2c18870035bec2a0f33a0f9f4fb0adce3b87f9e73"} Jul 13 03:47:41.975454 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:41.975428 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:42.116722 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.116699 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npb9m\" (UniqueName: \"kubernetes.io/projected/0ca0bcaa-ce66-45af-b007-72518c14b7ea-kube-api-access-npb9m\") pod \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " Jul 13 03:47:42.116808 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.116781 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-bundle\") pod \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " Jul 13 03:47:42.116808 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.116801 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-util\") pod \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\" (UID: \"0ca0bcaa-ce66-45af-b007-72518c14b7ea\") " Jul 13 03:47:42.117273 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.117244 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-bundle" (OuterVolumeSpecName: "bundle") pod "0ca0bcaa-ce66-45af-b007-72518c14b7ea" (UID: "0ca0bcaa-ce66-45af-b007-72518c14b7ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:42.118998 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.118975 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca0bcaa-ce66-45af-b007-72518c14b7ea-kube-api-access-npb9m" (OuterVolumeSpecName: "kube-api-access-npb9m") pod "0ca0bcaa-ce66-45af-b007-72518c14b7ea" (UID: "0ca0bcaa-ce66-45af-b007-72518c14b7ea"). InnerVolumeSpecName "kube-api-access-npb9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:47:42.122274 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.122234 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-util" (OuterVolumeSpecName: "util") pod "0ca0bcaa-ce66-45af-b007-72518c14b7ea" (UID: "0ca0bcaa-ce66-45af-b007-72518c14b7ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:42.217628 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.217562 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npb9m\" (UniqueName: \"kubernetes.io/projected/0ca0bcaa-ce66-45af-b007-72518c14b7ea-kube-api-access-npb9m\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:42.217628 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.217587 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:42.217628 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.217598 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca0bcaa-ce66-45af-b007-72518c14b7ea-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:42.839536 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.839504 2566 generic.go:356] "Generic (PLEG): container finished" podID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerID="b8f56fc4c68fd4e1aeb48ce775cc9bfbb112a7fbfdb42f5e0d9ccd3af57137ab" exitCode=0 Jul 13 03:47:42.839980 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.839601 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" event={"ID":"1a77d927-b889-4307-be07-a2fe0bf2d9e0","Type":"ContainerDied","Data":"b8f56fc4c68fd4e1aeb48ce775cc9bfbb112a7fbfdb42f5e0d9ccd3af57137ab"} Jul 13 03:47:42.841788 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.841769 2566 generic.go:356] "Generic (PLEG): container finished" podID="a59541cc-a42c-469d-ba21-f07624fe8466" containerID="3060d0e189458f6e2dbf730b695a7bd4e9e376325cfff6ef49a93533bc2d0944" exitCode=0 Jul 13 03:47:42.841888 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.841849 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" event={"ID":"a59541cc-a42c-469d-ba21-f07624fe8466","Type":"ContainerDied","Data":"3060d0e189458f6e2dbf730b695a7bd4e9e376325cfff6ef49a93533bc2d0944"} Jul 13 03:47:42.843939 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.843920 2566 generic.go:356] "Generic (PLEG): container finished" podID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerID="3bc456649e01b00205325e02ecb6e1ed778964db5692493dda28abff6d20e0f4" exitCode=0 Jul 13 03:47:42.844034 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.843943 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" event={"ID":"5e309cb0-9eab-4b21-8611-9e35ff27907d","Type":"ContainerDied","Data":"3bc456649e01b00205325e02ecb6e1ed778964db5692493dda28abff6d20e0f4"} Jul 13 03:47:42.845654 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.845636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" event={"ID":"0ca0bcaa-ce66-45af-b007-72518c14b7ea","Type":"ContainerDied","Data":"3b5d7f54c46fbdd59e8d64925ea90559fd42830dd0c331379b7cdb957f79ebd0"} Jul 13 03:47:42.845728 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.845667 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b5d7f54c46fbdd59e8d64925ea90559fd42830dd0c331379b7cdb957f79ebd0" Jul 13 03:47:42.845728 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:42.845674 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp" Jul 13 03:47:44.018943 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.018918 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:44.052611 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.052584 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:44.055737 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.055716 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:44.136079 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136001 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-bundle\") pod \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " Jul 13 03:47:44.136079 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136038 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-util\") pod \"a59541cc-a42c-469d-ba21-f07624fe8466\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " Jul 13 03:47:44.136079 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136072 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-util\") pod \"5e309cb0-9eab-4b21-8611-9e35ff27907d\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " Jul 13 03:47:44.136345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136120 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-util\") pod \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " Jul 13 03:47:44.136345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136150 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxhdg\" (UniqueName: \"kubernetes.io/projected/5e309cb0-9eab-4b21-8611-9e35ff27907d-kube-api-access-dxhdg\") pod \"5e309cb0-9eab-4b21-8611-9e35ff27907d\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " Jul 13 03:47:44.136345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136198 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pttvq\" (UniqueName: \"kubernetes.io/projected/1a77d927-b889-4307-be07-a2fe0bf2d9e0-kube-api-access-pttvq\") pod \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\" (UID: \"1a77d927-b889-4307-be07-a2fe0bf2d9e0\") " Jul 13 03:47:44.136345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136235 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-bundle\") pod \"5e309cb0-9eab-4b21-8611-9e35ff27907d\" (UID: \"5e309cb0-9eab-4b21-8611-9e35ff27907d\") " Jul 13 03:47:44.136345 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136279 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-bundle\") pod \"a59541cc-a42c-469d-ba21-f07624fe8466\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " Jul 13 03:47:44.136994 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.136962 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-bundle" (OuterVolumeSpecName: "bundle") pod "a59541cc-a42c-469d-ba21-f07624fe8466" (UID: "a59541cc-a42c-469d-ba21-f07624fe8466"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:44.137088 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.137067 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-bundle" (OuterVolumeSpecName: "bundle") pod "1a77d927-b889-4307-be07-a2fe0bf2d9e0" (UID: "1a77d927-b889-4307-be07-a2fe0bf2d9e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:44.137172 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.137135 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-bundle" (OuterVolumeSpecName: "bundle") pod "5e309cb0-9eab-4b21-8611-9e35ff27907d" (UID: "5e309cb0-9eab-4b21-8611-9e35ff27907d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:44.137300 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.137188 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2zp4\" (UniqueName: \"kubernetes.io/projected/a59541cc-a42c-469d-ba21-f07624fe8466-kube-api-access-k2zp4\") pod \"a59541cc-a42c-469d-ba21-f07624fe8466\" (UID: \"a59541cc-a42c-469d-ba21-f07624fe8466\") " Jul 13 03:47:44.137518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.137477 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.137518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.137520 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.137666 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.137533 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.138840 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.138806 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e309cb0-9eab-4b21-8611-9e35ff27907d-kube-api-access-dxhdg" (OuterVolumeSpecName: "kube-api-access-dxhdg") pod "5e309cb0-9eab-4b21-8611-9e35ff27907d" (UID: "5e309cb0-9eab-4b21-8611-9e35ff27907d"). InnerVolumeSpecName "kube-api-access-dxhdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:47:44.139139 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.139121 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59541cc-a42c-469d-ba21-f07624fe8466-kube-api-access-k2zp4" (OuterVolumeSpecName: "kube-api-access-k2zp4") pod "a59541cc-a42c-469d-ba21-f07624fe8466" (UID: "a59541cc-a42c-469d-ba21-f07624fe8466"). InnerVolumeSpecName "kube-api-access-k2zp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:47:44.139365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.139340 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a77d927-b889-4307-be07-a2fe0bf2d9e0-kube-api-access-pttvq" (OuterVolumeSpecName: "kube-api-access-pttvq") pod "1a77d927-b889-4307-be07-a2fe0bf2d9e0" (UID: "1a77d927-b889-4307-be07-a2fe0bf2d9e0"). InnerVolumeSpecName "kube-api-access-pttvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:47:44.141919 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.141897 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-util" (OuterVolumeSpecName: "util") pod "a59541cc-a42c-469d-ba21-f07624fe8466" (UID: "a59541cc-a42c-469d-ba21-f07624fe8466"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:44.143100 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.143065 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-util" (OuterVolumeSpecName: "util") pod "1a77d927-b889-4307-be07-a2fe0bf2d9e0" (UID: "1a77d927-b889-4307-be07-a2fe0bf2d9e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:44.144908 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.144883 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-util" (OuterVolumeSpecName: "util") pod "5e309cb0-9eab-4b21-8611-9e35ff27907d" (UID: "5e309cb0-9eab-4b21-8611-9e35ff27907d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:47:44.238910 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.238863 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2zp4\" (UniqueName: \"kubernetes.io/projected/a59541cc-a42c-469d-ba21-f07624fe8466-kube-api-access-k2zp4\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.238910 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.238907 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a59541cc-a42c-469d-ba21-f07624fe8466-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.238910 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.238918 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e309cb0-9eab-4b21-8611-9e35ff27907d-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.238910 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.238926 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a77d927-b889-4307-be07-a2fe0bf2d9e0-util\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.239154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.238933 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxhdg\" (UniqueName: \"kubernetes.io/projected/5e309cb0-9eab-4b21-8611-9e35ff27907d-kube-api-access-dxhdg\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.239154 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.238943 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pttvq\" (UniqueName: \"kubernetes.io/projected/1a77d927-b889-4307-be07-a2fe0bf2d9e0-kube-api-access-pttvq\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:47:44.856876 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.856846 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" Jul 13 03:47:44.857077 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.856874 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt" event={"ID":"5e309cb0-9eab-4b21-8611-9e35ff27907d","Type":"ContainerDied","Data":"ff6ba4730833b9a02770fd83801e3f69035afb4872d95e745cda18c162ea75ec"} Jul 13 03:47:44.857077 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.856958 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff6ba4730833b9a02770fd83801e3f69035afb4872d95e745cda18c162ea75ec" Jul 13 03:47:44.858838 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.858809 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" event={"ID":"1a77d927-b889-4307-be07-a2fe0bf2d9e0","Type":"ContainerDied","Data":"c7a51c03b145fa593eb1cff5651f92468035842f13a53d03350cb69abd2f5014"} Jul 13 03:47:44.858951 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.858857 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7a51c03b145fa593eb1cff5651f92468035842f13a53d03350cb69abd2f5014" Jul 13 03:47:44.858951 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.858818 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf" Jul 13 03:47:44.860789 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.860767 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" event={"ID":"a59541cc-a42c-469d-ba21-f07624fe8466","Type":"ContainerDied","Data":"1bcb6f8f45dc5694104848a5c348aa065bb5055c69d811412a4e5be411424d83"} Jul 13 03:47:44.860885 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.860790 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7" Jul 13 03:47:44.860885 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:47:44.860802 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bcb6f8f45dc5694104848a5c348aa065bb5055c69d811412a4e5be411424d83" Jul 13 03:48:16.034785 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.034749 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz"] Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035048 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035059 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035070 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035076 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035084 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035090 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035098 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035104 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035109 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035114 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035124 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035129 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035136 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035140 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035146 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035151 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035159 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035163 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="util" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035169 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035174 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="pull" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035180 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035185 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035192 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035197 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035246 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e309cb0-9eab-4b21-8611-9e35ff27907d" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035253 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca0bcaa-ce66-45af-b007-72518c14b7ea" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035263 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a77d927-b889-4307-be07-a2fe0bf2d9e0" containerName="extract" Jul 13 03:48:16.035281 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.035269 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59541cc-a42c-469d-ba21-f07624fe8466" containerName="extract" Jul 13 03:48:16.039757 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.039740 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.043782 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.043757 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 03:48:16.043926 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.043762 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cb4fl\"" Jul 13 03:48:16.044118 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.044087 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 03:48:16.051635 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.051610 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz"] Jul 13 03:48:16.101423 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.101390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxs6h\" (UniqueName: \"kubernetes.io/projected/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-kube-api-access-lxs6h\") pod \"kuadrant-operator-controller-manager-86878c769f-tprtz\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.101600 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.101524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tprtz\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.202705 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.202668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tprtz\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.202859 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.202714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxs6h\" (UniqueName: \"kubernetes.io/projected/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-kube-api-access-lxs6h\") pod \"kuadrant-operator-controller-manager-86878c769f-tprtz\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.203083 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.203063 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tprtz\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.211592 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.211562 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxs6h\" (UniqueName: \"kubernetes.io/projected/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-kube-api-access-lxs6h\") pod \"kuadrant-operator-controller-manager-86878c769f-tprtz\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.350219 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.350136 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:16.485365 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:16.485340 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz"] Jul 13 03:48:16.488287 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:48:16.488253 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9edd5a4b_2fd6_480d_9d80_2f2de8824aa8.slice/crio-592a195b6d6fbce93653c6a4b5deced354763cdf97e7873aab0ac1d8f8b5c734 WatchSource:0}: Error finding container 592a195b6d6fbce93653c6a4b5deced354763cdf97e7873aab0ac1d8f8b5c734: Status 404 returned error can't find the container with id 592a195b6d6fbce93653c6a4b5deced354763cdf97e7873aab0ac1d8f8b5c734 Jul 13 03:48:17.017950 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:17.017917 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" event={"ID":"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8","Type":"ContainerStarted","Data":"592a195b6d6fbce93653c6a4b5deced354763cdf97e7873aab0ac1d8f8b5c734"} Jul 13 03:48:22.049313 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:22.049279 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" event={"ID":"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8","Type":"ContainerStarted","Data":"084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664"} Jul 13 03:48:22.049700 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:22.049410 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:48:22.068181 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:22.068134 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" podStartSLOduration=1.469020595 podStartE2EDuration="6.0681192s" totalImagesPullingTime="4.599098605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:22.0665993 +0000 UTC m=+432.677626098" watchObservedRunningTime="2026-07-13 03:48:22.0681192 +0000 UTC m=+432.679146001" Jul 13 03:48:33.056618 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:48:33.056541 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:49:32.197021 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.196987 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8476d89dc8-dwvsn"] Jul 13 03:49:32.199252 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.199234 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.201825 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.201791 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ckb6x\"" Jul 13 03:49:32.201926 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.201845 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 03:49:32.201926 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.201890 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 03:49:32.202140 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.202123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.202206 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.202189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5l8w\" (UniqueName: \"kubernetes.io/projected/c929501e-4b85-4387-98c8-ab561470fd49-kube-api-access-f5l8w\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.210338 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.210318 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-dwvsn"] Jul 13 03:49:32.303672 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.303635 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.303852 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.303692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5l8w\" (UniqueName: \"kubernetes.io/projected/c929501e-4b85-4387-98c8-ab561470fd49-kube-api-access-f5l8w\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.303852 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:49:32.303780 2566 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 13 03:49:32.303928 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:49:32.303851 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert podName:c929501e-4b85-4387-98c8-ab561470fd49 nodeName:}" failed. No retries permitted until 2026-07-13 03:49:32.803833066 +0000 UTC m=+503.414859841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert") pod "maas-controller-8476d89dc8-dwvsn" (UID: "c929501e-4b85-4387-98c8-ab561470fd49") : secret "maas-controller-webhook-cert" not found Jul 13 03:49:32.311914 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.311889 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5l8w\" (UniqueName: \"kubernetes.io/projected/c929501e-4b85-4387-98c8-ab561470fd49-kube-api-access-f5l8w\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.807149 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.807112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:32.809599 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:32.809579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert\") pod \"maas-controller-8476d89dc8-dwvsn\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:33.109358 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:33.109264 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:33.238833 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:33.238806 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-dwvsn"] Jul 13 03:49:33.240433 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:49:33.240401 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc929501e_4b85_4387_98c8_ab561470fd49.slice/crio-3d3490259bbc03766856c09fb54c0daaa0a39e7062f88e70103b4b0ab11baefb WatchSource:0}: Error finding container 3d3490259bbc03766856c09fb54c0daaa0a39e7062f88e70103b4b0ab11baefb: Status 404 returned error can't find the container with id 3d3490259bbc03766856c09fb54c0daaa0a39e7062f88e70103b4b0ab11baefb Jul 13 03:49:33.397306 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:33.397222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" event={"ID":"c929501e-4b85-4387-98c8-ab561470fd49","Type":"ContainerStarted","Data":"3d3490259bbc03766856c09fb54c0daaa0a39e7062f88e70103b4b0ab11baefb"} Jul 13 03:49:35.411836 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:35.411741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" event={"ID":"c929501e-4b85-4387-98c8-ab561470fd49","Type":"ContainerStarted","Data":"b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba"} Jul 13 03:49:35.412211 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:35.411885 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:35.430163 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:35.430113 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" podStartSLOduration=1.601063055 podStartE2EDuration="3.430098825s" totalImagesPullingTime="1.82903577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:49:35.429012213 +0000 UTC m=+506.040039011" watchObservedRunningTime="2026-07-13 03:49:35.430098825 +0000 UTC m=+506.041125621" Jul 13 03:49:46.422373 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:46.422344 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:47.088595 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.088562 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-dwvsn"] Jul 13 03:49:47.088768 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.088728 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" podUID="c929501e-4b85-4387-98c8-ab561470fd49" containerName="manager" containerID="cri-o://b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba" gracePeriod=30 Jul 13 03:49:47.328991 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.328966 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:47.405753 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.405682 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert\") pod \"c929501e-4b85-4387-98c8-ab561470fd49\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " Jul 13 03:49:47.405885 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.405762 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5l8w\" (UniqueName: \"kubernetes.io/projected/c929501e-4b85-4387-98c8-ab561470fd49-kube-api-access-f5l8w\") pod \"c929501e-4b85-4387-98c8-ab561470fd49\" (UID: \"c929501e-4b85-4387-98c8-ab561470fd49\") " Jul 13 03:49:47.408009 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.407981 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c929501e-4b85-4387-98c8-ab561470fd49" (UID: "c929501e-4b85-4387-98c8-ab561470fd49"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:49:47.408110 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.407982 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c929501e-4b85-4387-98c8-ab561470fd49-kube-api-access-f5l8w" (OuterVolumeSpecName: "kube-api-access-f5l8w") pod "c929501e-4b85-4387-98c8-ab561470fd49" (UID: "c929501e-4b85-4387-98c8-ab561470fd49"). InnerVolumeSpecName "kube-api-access-f5l8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:49:47.476801 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.476768 2566 generic.go:356] "Generic (PLEG): container finished" podID="c929501e-4b85-4387-98c8-ab561470fd49" containerID="b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba" exitCode=0 Jul 13 03:49:47.477257 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.476821 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" Jul 13 03:49:47.477257 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.476858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" event={"ID":"c929501e-4b85-4387-98c8-ab561470fd49","Type":"ContainerDied","Data":"b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba"} Jul 13 03:49:47.477257 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.476952 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8476d89dc8-dwvsn" event={"ID":"c929501e-4b85-4387-98c8-ab561470fd49","Type":"ContainerDied","Data":"3d3490259bbc03766856c09fb54c0daaa0a39e7062f88e70103b4b0ab11baefb"} Jul 13 03:49:47.477257 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.476982 2566 scope.go:117] "RemoveContainer" containerID="b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba" Jul 13 03:49:47.486384 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.486367 2566 scope.go:117] "RemoveContainer" containerID="b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba" Jul 13 03:49:47.486686 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:49:47.486668 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba\": container with ID starting with b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba not found: ID does not exist" containerID="b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba" Jul 13 03:49:47.486739 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.486694 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba"} err="failed to get container status \"b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba\": rpc error: code = NotFound desc = could not find container \"b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba\": container with ID starting with b2015ec3df15885911e08e950dc6f32c079397a2731f212ebbc4ad2c7eaa6cba not found: ID does not exist" Jul 13 03:49:47.497442 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.497421 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-dwvsn"] Jul 13 03:49:47.501554 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.501532 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8476d89dc8-dwvsn"] Jul 13 03:49:47.506836 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.506819 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5l8w\" (UniqueName: \"kubernetes.io/projected/c929501e-4b85-4387-98c8-ab561470fd49-kube-api-access-f5l8w\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:49:47.506895 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.506839 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c929501e-4b85-4387-98c8-ab561470fd49-webhook-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:49:47.928769 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:49:47.928730 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c929501e-4b85-4387-98c8-ab561470fd49" path="/var/lib/kubelet/pods/c929501e-4b85-4387-98c8-ab561470fd49/volumes" Jul 13 03:50:07.615042 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.614962 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-5zjrz"] Jul 13 03:50:07.615518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.615296 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c929501e-4b85-4387-98c8-ab561470fd49" containerName="manager" Jul 13 03:50:07.615518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.615312 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c929501e-4b85-4387-98c8-ab561470fd49" containerName="manager" Jul 13 03:50:07.615518 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.615368 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c929501e-4b85-4387-98c8-ab561470fd49" containerName="manager" Jul 13 03:50:07.618248 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.618232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.620434 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.620407 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 03:50:07.627885 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.627854 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-5zjrz"] Jul 13 03:50:07.663031 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.662994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq8kk\" (UniqueName: \"kubernetes.io/projected/1daf5fc4-a51c-4cff-b183-b52dfaec783b-kube-api-access-xq8kk\") pod \"payload-pre-processing-7964457696-5zjrz\" (UID: \"1daf5fc4-a51c-4cff-b183-b52dfaec783b\") " pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.663206 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.663057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daf5fc4-a51c-4cff-b183-b52dfaec783b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-5zjrz\" (UID: \"1daf5fc4-a51c-4cff-b183-b52dfaec783b\") " pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.664093 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.664067 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qhmvq"] Jul 13 03:50:07.667380 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.667364 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.670221 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.670202 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5cxt8\"" Jul 13 03:50:07.679533 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.679478 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qhmvq"] Jul 13 03:50:07.763953 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.763919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq8kk\" (UniqueName: \"kubernetes.io/projected/1daf5fc4-a51c-4cff-b183-b52dfaec783b-kube-api-access-xq8kk\") pod \"payload-pre-processing-7964457696-5zjrz\" (UID: \"1daf5fc4-a51c-4cff-b183-b52dfaec783b\") " pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.764144 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.763966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kbqj\" (UniqueName: \"kubernetes.io/projected/083e75aa-150c-4d8b-a29e-9b5ea9656940-kube-api-access-5kbqj\") pod \"payload-processing-58f86c7798-qhmvq\" (UID: \"083e75aa-150c-4d8b-a29e-9b5ea9656940\") " pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.764144 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.764025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daf5fc4-a51c-4cff-b183-b52dfaec783b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-5zjrz\" (UID: \"1daf5fc4-a51c-4cff-b183-b52dfaec783b\") " pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.764144 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.764053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/083e75aa-150c-4d8b-a29e-9b5ea9656940-plugins-config-volume\") pod \"payload-processing-58f86c7798-qhmvq\" (UID: \"083e75aa-150c-4d8b-a29e-9b5ea9656940\") " pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.764773 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.764754 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1daf5fc4-a51c-4cff-b183-b52dfaec783b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-5zjrz\" (UID: \"1daf5fc4-a51c-4cff-b183-b52dfaec783b\") " pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.774979 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.774950 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq8kk\" (UniqueName: \"kubernetes.io/projected/1daf5fc4-a51c-4cff-b183-b52dfaec783b-kube-api-access-xq8kk\") pod \"payload-pre-processing-7964457696-5zjrz\" (UID: \"1daf5fc4-a51c-4cff-b183-b52dfaec783b\") " pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.865552 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.865448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/083e75aa-150c-4d8b-a29e-9b5ea9656940-plugins-config-volume\") pod \"payload-processing-58f86c7798-qhmvq\" (UID: \"083e75aa-150c-4d8b-a29e-9b5ea9656940\") " pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.865714 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.865596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kbqj\" (UniqueName: \"kubernetes.io/projected/083e75aa-150c-4d8b-a29e-9b5ea9656940-kube-api-access-5kbqj\") pod \"payload-processing-58f86c7798-qhmvq\" (UID: \"083e75aa-150c-4d8b-a29e-9b5ea9656940\") " pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.866157 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.866137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/083e75aa-150c-4d8b-a29e-9b5ea9656940-plugins-config-volume\") pod \"payload-processing-58f86c7798-qhmvq\" (UID: \"083e75aa-150c-4d8b-a29e-9b5ea9656940\") " pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.873244 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.873207 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kbqj\" (UniqueName: \"kubernetes.io/projected/083e75aa-150c-4d8b-a29e-9b5ea9656940-kube-api-access-5kbqj\") pod \"payload-processing-58f86c7798-qhmvq\" (UID: \"083e75aa-150c-4d8b-a29e-9b5ea9656940\") " pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:07.928905 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.928877 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:07.978224 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:07.978194 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:08.078832 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:08.078799 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-5zjrz"] Jul 13 03:50:08.081396 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:50:08.081362 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1daf5fc4_a51c_4cff_b183_b52dfaec783b.slice/crio-eec4e9b242f592c3c7fada81069eed01fb65e65859983f7c27b0e21ef27a98fa WatchSource:0}: Error finding container eec4e9b242f592c3c7fada81069eed01fb65e65859983f7c27b0e21ef27a98fa: Status 404 returned error can't find the container with id eec4e9b242f592c3c7fada81069eed01fb65e65859983f7c27b0e21ef27a98fa Jul 13 03:50:08.122323 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:08.122297 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qhmvq"] Jul 13 03:50:08.124671 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:50:08.124641 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083e75aa_150c_4d8b_a29e_9b5ea9656940.slice/crio-917d3725fdc412766a52f98ba8b652fd8f0af97def6f1b1ed7e5fb823a220f3e WatchSource:0}: Error finding container 917d3725fdc412766a52f98ba8b652fd8f0af97def6f1b1ed7e5fb823a220f3e: Status 404 returned error can't find the container with id 917d3725fdc412766a52f98ba8b652fd8f0af97def6f1b1ed7e5fb823a220f3e Jul 13 03:50:08.583549 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:08.583513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" event={"ID":"083e75aa-150c-4d8b-a29e-9b5ea9656940","Type":"ContainerStarted","Data":"917d3725fdc412766a52f98ba8b652fd8f0af97def6f1b1ed7e5fb823a220f3e"} Jul 13 03:50:08.584686 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:08.584662 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" event={"ID":"1daf5fc4-a51c-4cff-b183-b52dfaec783b","Type":"ContainerStarted","Data":"eec4e9b242f592c3c7fada81069eed01fb65e65859983f7c27b0e21ef27a98fa"} Jul 13 03:50:09.594077 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:09.594041 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" event={"ID":"083e75aa-150c-4d8b-a29e-9b5ea9656940","Type":"ContainerStarted","Data":"2ae572b433c790ac1a5c61072679696995a3ce8213a2d2ab45ea67eecfc6254f"} Jul 13 03:50:09.594544 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:09.594104 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:09.595472 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:09.595448 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" event={"ID":"1daf5fc4-a51c-4cff-b183-b52dfaec783b","Type":"ContainerStarted","Data":"b2100b582047de9a2945850cba6df5cb17eb0057e2d1ec3a8d1413e4c839493c"} Jul 13 03:50:09.595613 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:09.595592 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:50:09.610285 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:09.610245 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" podStartSLOduration=1.338012815 podStartE2EDuration="2.610231048s" totalImagesPullingTime="1.272218233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:50:09.607537164 +0000 UTC m=+540.218563961" watchObservedRunningTime="2026-07-13 03:50:09.610231048 +0000 UTC m=+540.221257845" Jul 13 03:50:09.622243 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:09.622198 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" podStartSLOduration=1.3100607420000001 podStartE2EDuration="2.622183178s" totalImagesPullingTime="1.312122436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:50:09.620199456 +0000 UTC m=+540.231226253" watchObservedRunningTime="2026-07-13 03:50:09.622183178 +0000 UTC m=+540.233209975" Jul 13 03:50:20.602945 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:20.602911 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-qhmvq" Jul 13 03:50:20.603382 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:50:20.603062 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-5zjrz" Jul 13 03:51:00.876758 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.876726 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fljts"] Jul 13 03:51:00.881008 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.880985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:00.883835 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.883649 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 13 03:51:00.883835 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.883715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 03:51:00.884884 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.884853 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 03:51:00.885017 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.884995 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w2wk8\"" Jul 13 03:51:00.890187 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.890008 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fljts"] Jul 13 03:51:00.908071 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.908038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:00.908191 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.908078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:00.908191 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.908112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd48768-d656-420e-8b54-658192b5477a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:00.908191 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.908140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:00.908191 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.908177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nfh\" (UniqueName: \"kubernetes.io/projected/8bd48768-d656-420e-8b54-658192b5477a-kube-api-access-v5nfh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:00.908331 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:00.908223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.008892 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.008860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.008892 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.008898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009115 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.008978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd48768-d656-420e-8b54-658192b5477a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009115 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.009038 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009353 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.009330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009418 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.009356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009418 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.009376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nfh\" (UniqueName: \"kubernetes.io/projected/8bd48768-d656-420e-8b54-658192b5477a-kube-api-access-v5nfh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009529 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.009421 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.009776 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.009747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.011354 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.011335 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd48768-d656-420e-8b54-658192b5477a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.011637 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.011619 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd48768-d656-420e-8b54-658192b5477a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.016641 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.016619 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nfh\" (UniqueName: \"kubernetes.io/projected/8bd48768-d656-420e-8b54-658192b5477a-kube-api-access-v5nfh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fljts\" (UID: \"8bd48768-d656-420e-8b54-658192b5477a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.194831 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.194744 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:01.329225 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.329200 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fljts"] Jul 13 03:51:01.331437 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:51:01.331410 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd48768_d656_420e_8b54_658192b5477a.slice/crio-fe28537f27d56696523143a5dc0094f308737bb7ce40f6b85377ec434fcb59a8 WatchSource:0}: Error finding container fe28537f27d56696523143a5dc0094f308737bb7ce40f6b85377ec434fcb59a8: Status 404 returned error can't find the container with id fe28537f27d56696523143a5dc0094f308737bb7ce40f6b85377ec434fcb59a8 Jul 13 03:51:01.864521 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:01.864463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" event={"ID":"8bd48768-d656-420e-8b54-658192b5477a","Type":"ContainerStarted","Data":"fe28537f27d56696523143a5dc0094f308737bb7ce40f6b85377ec434fcb59a8"} Jul 13 03:51:02.871736 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:02.871702 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" event={"ID":"8bd48768-d656-420e-8b54-658192b5477a","Type":"ContainerStarted","Data":"cc9006bda07a93a3438a991b59f200410aedc3809ee04eb8feefb15d145da941"} Jul 13 03:51:02.889687 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:02.889637 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" podStartSLOduration=1.856704491 podStartE2EDuration="2.889622404s" totalImagesPullingTime="1.032917913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:51:02.887221504 +0000 UTC m=+593.498248302" watchObservedRunningTime="2026-07-13 03:51:02.889622404 +0000 UTC m=+593.500649201" Jul 13 03:51:09.857548 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:09.857520 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:51:09.861276 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:09.861252 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:51:09.862173 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:09.862155 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:51:09.866034 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:09.866016 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:51:11.195435 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:11.195390 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:11.195954 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:11.195470 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:11.207789 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:11.207765 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:51:11.929372 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:51:11.929343 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fljts" Jul 13 03:53:48.008349 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.008290 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59f8b857c-gfw8n"] Jul 13 03:53:48.011707 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.011690 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.014086 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.014064 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 03:53:48.015157 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.015126 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ckb6x\"" Jul 13 03:53:48.015157 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.015132 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 03:53:48.020810 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.020786 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f8b857c-gfw8n"] Jul 13 03:53:48.102696 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.102658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9rht\" (UniqueName: \"kubernetes.io/projected/6f941cd2-078a-4279-b00d-879a7ae486d0-kube-api-access-h9rht\") pod \"maas-controller-59f8b857c-gfw8n\" (UID: \"6f941cd2-078a-4279-b00d-879a7ae486d0\") " pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.102889 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.102725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f941cd2-078a-4279-b00d-879a7ae486d0-webhook-cert\") pod \"maas-controller-59f8b857c-gfw8n\" (UID: \"6f941cd2-078a-4279-b00d-879a7ae486d0\") " pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.204055 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.204020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f941cd2-078a-4279-b00d-879a7ae486d0-webhook-cert\") pod \"maas-controller-59f8b857c-gfw8n\" (UID: \"6f941cd2-078a-4279-b00d-879a7ae486d0\") " pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.204233 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.204090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9rht\" (UniqueName: \"kubernetes.io/projected/6f941cd2-078a-4279-b00d-879a7ae486d0-kube-api-access-h9rht\") pod \"maas-controller-59f8b857c-gfw8n\" (UID: \"6f941cd2-078a-4279-b00d-879a7ae486d0\") " pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.206556 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.206529 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f941cd2-078a-4279-b00d-879a7ae486d0-webhook-cert\") pod \"maas-controller-59f8b857c-gfw8n\" (UID: \"6f941cd2-078a-4279-b00d-879a7ae486d0\") " pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.212186 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.212163 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9rht\" (UniqueName: \"kubernetes.io/projected/6f941cd2-078a-4279-b00d-879a7ae486d0-kube-api-access-h9rht\") pod \"maas-controller-59f8b857c-gfw8n\" (UID: \"6f941cd2-078a-4279-b00d-879a7ae486d0\") " pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.322800 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.322702 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:48.663205 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.663179 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f8b857c-gfw8n"] Jul 13 03:53:48.665127 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:53:48.665093 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f941cd2_078a_4279_b00d_879a7ae486d0.slice/crio-013ccddfb7d79548985507b71b2efcb266cf6655308ad9cf6e4e871f1130a29d WatchSource:0}: Error finding container 013ccddfb7d79548985507b71b2efcb266cf6655308ad9cf6e4e871f1130a29d: Status 404 returned error can't find the container with id 013ccddfb7d79548985507b71b2efcb266cf6655308ad9cf6e4e871f1130a29d Jul 13 03:53:48.666453 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.666435 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:53:48.685735 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:48.685711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f8b857c-gfw8n" event={"ID":"6f941cd2-078a-4279-b00d-879a7ae486d0","Type":"ContainerStarted","Data":"013ccddfb7d79548985507b71b2efcb266cf6655308ad9cf6e4e871f1130a29d"} Jul 13 03:53:49.692760 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:49.692724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f8b857c-gfw8n" event={"ID":"6f941cd2-078a-4279-b00d-879a7ae486d0","Type":"ContainerStarted","Data":"60dc89f4015153af94d5534d5db7063766a1b49d7bddf0e39387eae631a02fdf"} Jul 13 03:53:49.693144 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:49.692790 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:53:49.708846 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:53:49.708800 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59f8b857c-gfw8n" podStartSLOduration=2.311218887 podStartE2EDuration="2.708784218s" totalImagesPullingTime="397.565331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:53:49.707010465 +0000 UTC m=+760.318037263" watchObservedRunningTime="2026-07-13 03:53:49.708784218 +0000 UTC m=+760.319811015" Jul 13 03:54:00.704378 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:54:00.704346 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59f8b857c-gfw8n" Jul 13 03:56:09.895959 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:56:09.895887 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:56:09.897332 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:56:09.897312 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 03:56:09.900917 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:56:09.900898 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:56:09.902299 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:56:09.902272 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 03:58:29.423283 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:29.423245 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz"] Jul 13 03:58:29.426008 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:29.423450 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" podUID="9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" containerName="manager" containerID="cri-o://084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664" gracePeriod=10 Jul 13 03:58:32.066864 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.066838 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:58:32.118470 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.118438 2566 generic.go:356] "Generic (PLEG): container finished" podID="9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" containerID="084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664" exitCode=0 Jul 13 03:58:32.118664 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.118476 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" Jul 13 03:58:32.118664 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.118511 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" event={"ID":"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8","Type":"ContainerDied","Data":"084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664"} Jul 13 03:58:32.118664 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.118577 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz" event={"ID":"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8","Type":"ContainerDied","Data":"592a195b6d6fbce93653c6a4b5deced354763cdf97e7873aab0ac1d8f8b5c734"} Jul 13 03:58:32.118664 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.118607 2566 scope.go:117] "RemoveContainer" containerID="084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664" Jul 13 03:58:32.128722 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.128702 2566 scope.go:117] "RemoveContainer" containerID="084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664" Jul 13 03:58:32.128986 ip-10-0-138-160 kubenswrapper[2566]: E0713 03:58:32.128966 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664\": container with ID starting with 084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664 not found: ID does not exist" containerID="084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664" Jul 13 03:58:32.129057 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.129000 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664"} err="failed to get container status \"084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664\": rpc error: code = NotFound desc = could not find container \"084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664\": container with ID starting with 084a024581047a1dcd5b8d1398a969f33ddac7e0b180276cf48ca64dff4cf664 not found: ID does not exist" Jul 13 03:58:32.159951 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.159922 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-extensions-socket-volume\") pod \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " Jul 13 03:58:32.160075 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.159960 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxs6h\" (UniqueName: \"kubernetes.io/projected/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-kube-api-access-lxs6h\") pod \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\" (UID: \"9edd5a4b-2fd6-480d-9d80-2f2de8824aa8\") " Jul 13 03:58:32.160267 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.160246 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" (UID: "9edd5a4b-2fd6-480d-9d80-2f2de8824aa8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:58:32.161901 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.161881 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-kube-api-access-lxs6h" (OuterVolumeSpecName: "kube-api-access-lxs6h") pod "9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" (UID: "9edd5a4b-2fd6-480d-9d80-2f2de8824aa8"). InnerVolumeSpecName "kube-api-access-lxs6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:58:32.260552 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.260523 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-extensions-socket-volume\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:58:32.260552 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.260552 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxs6h\" (UniqueName: \"kubernetes.io/projected/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8-kube-api-access-lxs6h\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 03:58:32.440369 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.440339 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz"] Jul 13 03:58:32.443728 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:32.443704 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tprtz"] Jul 13 03:58:33.928159 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:58:33.928123 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" path="/var/lib/kubelet/pods/9edd5a4b-2fd6-480d-9d80-2f2de8824aa8/volumes" Jul 13 03:59:30.533568 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.533532 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc"] Jul 13 03:59:30.533966 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.533879 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" containerName="manager" Jul 13 03:59:30.533966 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.533891 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" containerName="manager" Jul 13 03:59:30.534037 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.533974 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9edd5a4b-2fd6-480d-9d80-2f2de8824aa8" containerName="manager" Jul 13 03:59:30.538098 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.538082 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.540462 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.540438 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 03:59:30.540620 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.540594 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 03:59:30.540682 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.540596 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cb4fl\"" Jul 13 03:59:30.546779 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.546756 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc"] Jul 13 03:59:30.638059 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.638021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4adbf47-3b45-4666-aaca-473181a9284c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwsbc\" (UID: \"f4adbf47-3b45-4666-aaca-473181a9284c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.638059 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.638058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw4lm\" (UniqueName: \"kubernetes.io/projected/f4adbf47-3b45-4666-aaca-473181a9284c-kube-api-access-lw4lm\") pod \"kuadrant-operator-controller-manager-86878c769f-cwsbc\" (UID: \"f4adbf47-3b45-4666-aaca-473181a9284c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.739468 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.739429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4adbf47-3b45-4666-aaca-473181a9284c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwsbc\" (UID: \"f4adbf47-3b45-4666-aaca-473181a9284c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.739468 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.739468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw4lm\" (UniqueName: \"kubernetes.io/projected/f4adbf47-3b45-4666-aaca-473181a9284c-kube-api-access-lw4lm\") pod \"kuadrant-operator-controller-manager-86878c769f-cwsbc\" (UID: \"f4adbf47-3b45-4666-aaca-473181a9284c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.739816 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.739789 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4adbf47-3b45-4666-aaca-473181a9284c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwsbc\" (UID: \"f4adbf47-3b45-4666-aaca-473181a9284c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.761358 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.761322 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw4lm\" (UniqueName: \"kubernetes.io/projected/f4adbf47-3b45-4666-aaca-473181a9284c-kube-api-access-lw4lm\") pod \"kuadrant-operator-controller-manager-86878c769f-cwsbc\" (UID: \"f4adbf47-3b45-4666-aaca-473181a9284c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.849240 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.849152 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:30.988927 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:30.988901 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc"] Jul 13 03:59:30.991026 ip-10-0-138-160 kubenswrapper[2566]: W0713 03:59:30.991003 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4adbf47_3b45_4666_aaca_473181a9284c.slice/crio-1c5e65bf327e7775fe38739c8907d8f3470271b974380cad3ab822e31964c62b WatchSource:0}: Error finding container 1c5e65bf327e7775fe38739c8907d8f3470271b974380cad3ab822e31964c62b: Status 404 returned error can't find the container with id 1c5e65bf327e7775fe38739c8907d8f3470271b974380cad3ab822e31964c62b Jul 13 03:59:31.410867 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:31.410835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" event={"ID":"f4adbf47-3b45-4666-aaca-473181a9284c","Type":"ContainerStarted","Data":"0144b035aad09aad80213490da2fa4d53361839e1ea80d5bc9cc77170dc6445f"} Jul 13 03:59:31.411063 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:31.410895 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" event={"ID":"f4adbf47-3b45-4666-aaca-473181a9284c","Type":"ContainerStarted","Data":"1c5e65bf327e7775fe38739c8907d8f3470271b974380cad3ab822e31964c62b"} Jul 13 03:59:31.411063 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:31.410923 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 03:59:31.430654 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:31.430607 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" podStartSLOduration=1.430592755 podStartE2EDuration="1.430592755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:59:31.427337358 +0000 UTC m=+1102.038364155" watchObservedRunningTime="2026-07-13 03:59:31.430592755 +0000 UTC m=+1102.041619552" Jul 13 03:59:42.418064 ip-10-0-138-160 kubenswrapper[2566]: I0713 03:59:42.417982 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwsbc" Jul 13 04:00:00.146031 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.142858 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q"] Jul 13 04:00:00.147836 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.147804 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:00:00.151076 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.151037 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q"] Jul 13 04:00:00.151675 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.151646 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kd7hr\"" Jul 13 04:00:00.151918 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.151889 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 04:00:00.152206 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.152184 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 04:00:00.187261 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.187221 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdkw6\" (UniqueName: \"kubernetes.io/projected/ad5f8884-694e-400d-8ad4-87e1f66bb5bc-kube-api-access-hdkw6\") pod \"maas-api-key-cleanup-29731920-dzg8q\" (UID: \"ad5f8884-694e-400d-8ad4-87e1f66bb5bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:00:00.287851 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.287810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdkw6\" (UniqueName: \"kubernetes.io/projected/ad5f8884-694e-400d-8ad4-87e1f66bb5bc-kube-api-access-hdkw6\") pod \"maas-api-key-cleanup-29731920-dzg8q\" (UID: \"ad5f8884-694e-400d-8ad4-87e1f66bb5bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:00:00.296872 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.296841 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdkw6\" (UniqueName: \"kubernetes.io/projected/ad5f8884-694e-400d-8ad4-87e1f66bb5bc-kube-api-access-hdkw6\") pod \"maas-api-key-cleanup-29731920-dzg8q\" (UID: \"ad5f8884-694e-400d-8ad4-87e1f66bb5bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:00:00.460898 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.460810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:00:00.596144 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.596122 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q"] Jul 13 04:00:00.598102 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:00:00.598075 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5f8884_694e_400d_8ad4_87e1f66bb5bc.slice/crio-5e885bfcb2d8ae4b957c6aacd34bdb512a92eb9e19ab519eaed0f0ba33f61df2 WatchSource:0}: Error finding container 5e885bfcb2d8ae4b957c6aacd34bdb512a92eb9e19ab519eaed0f0ba33f61df2: Status 404 returned error can't find the container with id 5e885bfcb2d8ae4b957c6aacd34bdb512a92eb9e19ab519eaed0f0ba33f61df2 Jul 13 04:00:00.600441 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:00.600425 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 04:00:01.563084 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:01.563053 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" event={"ID":"ad5f8884-694e-400d-8ad4-87e1f66bb5bc","Type":"ContainerStarted","Data":"5e885bfcb2d8ae4b957c6aacd34bdb512a92eb9e19ab519eaed0f0ba33f61df2"} Jul 13 04:00:18.653209 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:18.653168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" event={"ID":"ad5f8884-694e-400d-8ad4-87e1f66bb5bc","Type":"ContainerStarted","Data":"dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7"} Jul 13 04:00:18.668601 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:00:18.668551 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" podStartSLOduration=1.52993392 podStartE2EDuration="18.668535391s" totalImagesPullingTime="17.138601471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:00:18.667434145 +0000 UTC m=+1149.278460942" watchObservedRunningTime="2026-07-13 04:00:18.668535391 +0000 UTC m=+1149.279562244" Jul 13 04:01:00.009996 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:00.009960 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q"] Jul 13 04:01:00.010511 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:00.010157 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" podUID="ad5f8884-694e-400d-8ad4-87e1f66bb5bc" containerName="cleanup" containerID="cri-o://dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7" gracePeriod=30 Jul 13 04:01:09.932897 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:09.932868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:01:09.933495 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:09.933465 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:01:09.937620 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:09.937587 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:01:09.938196 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:09.938177 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:01:30.183155 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:30.183131 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:01:30.242792 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:30.242757 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdkw6\" (UniqueName: \"kubernetes.io/projected/ad5f8884-694e-400d-8ad4-87e1f66bb5bc-kube-api-access-hdkw6\") pod \"ad5f8884-694e-400d-8ad4-87e1f66bb5bc\" (UID: \"ad5f8884-694e-400d-8ad4-87e1f66bb5bc\") " Jul 13 04:01:30.244942 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:30.244914 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad5f8884-694e-400d-8ad4-87e1f66bb5bc-kube-api-access-hdkw6" (OuterVolumeSpecName: "kube-api-access-hdkw6") pod "ad5f8884-694e-400d-8ad4-87e1f66bb5bc" (UID: "ad5f8884-694e-400d-8ad4-87e1f66bb5bc"). InnerVolumeSpecName "kube-api-access-hdkw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:01:30.343623 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:30.343557 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdkw6\" (UniqueName: \"kubernetes.io/projected/ad5f8884-694e-400d-8ad4-87e1f66bb5bc-kube-api-access-hdkw6\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:01:31.031014 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.030980 2566 generic.go:356] "Generic (PLEG): container finished" podID="ad5f8884-694e-400d-8ad4-87e1f66bb5bc" containerID="dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7" exitCode=137 Jul 13 04:01:31.031196 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.031028 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" Jul 13 04:01:31.031196 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.031065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" event={"ID":"ad5f8884-694e-400d-8ad4-87e1f66bb5bc","Type":"ContainerDied","Data":"dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7"} Jul 13 04:01:31.031196 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.031122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q" event={"ID":"ad5f8884-694e-400d-8ad4-87e1f66bb5bc","Type":"ContainerDied","Data":"5e885bfcb2d8ae4b957c6aacd34bdb512a92eb9e19ab519eaed0f0ba33f61df2"} Jul 13 04:01:31.031196 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.031153 2566 scope.go:117] "RemoveContainer" containerID="dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7" Jul 13 04:01:31.040626 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.040605 2566 scope.go:117] "RemoveContainer" containerID="dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7" Jul 13 04:01:31.040884 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:01:31.040866 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7\": container with ID starting with dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7 not found: ID does not exist" containerID="dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7" Jul 13 04:01:31.040941 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.040891 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7"} err="failed to get container status \"dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7\": rpc error: code = NotFound desc = could not find container \"dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7\": container with ID starting with dbee838cb557d65104f6426bcc0041880a8bb21b06ca4d8c212c2424c80860b7 not found: ID does not exist" Jul 13 04:01:31.051786 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.051760 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q"] Jul 13 04:01:31.057332 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.057311 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731920-dzg8q"] Jul 13 04:01:31.929393 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:01:31.929348 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad5f8884-694e-400d-8ad4-87e1f66bb5bc" path="/var/lib/kubelet/pods/ad5f8884-694e-400d-8ad4-87e1f66bb5bc/volumes" Jul 13 04:06:09.973214 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:06:09.973187 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:06:09.974278 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:06:09.974246 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:06:09.978127 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:06:09.978066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:06:09.979332 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:06:09.979310 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:11:10.007668 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:10.007634 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:11:10.011248 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:10.011222 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:11:10.012731 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:10.012709 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:11:10.015940 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:10.015919 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:11:25.242202 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.242162 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2"] Jul 13 04:11:25.242753 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.242731 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad5f8884-694e-400d-8ad4-87e1f66bb5bc" containerName="cleanup" Jul 13 04:11:25.242831 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.242757 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad5f8884-694e-400d-8ad4-87e1f66bb5bc" containerName="cleanup" Jul 13 04:11:25.242887 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.242860 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad5f8884-694e-400d-8ad4-87e1f66bb5bc" containerName="cleanup" Jul 13 04:11:25.246536 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.246507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.249164 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.249111 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-88358a-serving-cert\"" Jul 13 04:11:25.249164 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.249149 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 04:11:25.249339 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.249166 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kd7hr\"" Jul 13 04:11:25.250251 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.250230 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 04:11:25.257446 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.257414 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2"] Jul 13 04:11:25.331847 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.331814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.331847 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.331851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.332067 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.331875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72zr6\" (UniqueName: \"kubernetes.io/projected/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-kube-api-access-72zr6\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.432921 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.432879 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.432921 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.432919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.433191 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.432938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72zr6\" (UniqueName: \"kubernetes.io/projected/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-kube-api-access-72zr6\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.433191 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:11:25.433054 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-serving-cert: secret "maas-api-e2e-inf-b-88358a-serving-cert" not found Jul 13 04:11:25.433191 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:11:25.433146 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls podName:f35a9afa-ed28-4f45-9cf2-6b30d7f14a94 nodeName:}" failed. No retries permitted until 2026-07-13 04:11:25.933124997 +0000 UTC m=+1816.544151784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls") pod "maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" (UID: "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94") : secret "maas-api-e2e-inf-b-88358a-serving-cert" not found Jul 13 04:11:25.433577 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.433559 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.442151 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.442127 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72zr6\" (UniqueName: \"kubernetes.io/projected/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-kube-api-access-72zr6\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.936897 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:25.936865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:25.937069 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:11:25.936975 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-serving-cert: secret "maas-api-e2e-inf-b-88358a-serving-cert" not found Jul 13 04:11:25.937069 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:11:25.937035 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls podName:f35a9afa-ed28-4f45-9cf2-6b30d7f14a94 nodeName:}" failed. No retries permitted until 2026-07-13 04:11:26.937011995 +0000 UTC m=+1817.548038770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls") pod "maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" (UID: "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94") : secret "maas-api-e2e-inf-b-88358a-serving-cert" not found Jul 13 04:11:26.944130 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:26.944084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:26.946721 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:26.946688 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:27.059873 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:27.059833 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:27.201740 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:27.201710 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2"] Jul 13 04:11:27.204005 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:11:27.203975 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35a9afa_ed28_4f45_9cf2_6b30d7f14a94.slice/crio-f86e0a9b3e67885fe0ceedc082b5f09e8a0f1ab2bec647eea8eea9bb3bf5faf4 WatchSource:0}: Error finding container f86e0a9b3e67885fe0ceedc082b5f09e8a0f1ab2bec647eea8eea9bb3bf5faf4: Status 404 returned error can't find the container with id f86e0a9b3e67885fe0ceedc082b5f09e8a0f1ab2bec647eea8eea9bb3bf5faf4 Jul 13 04:11:27.205730 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:27.205710 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 04:11:28.085693 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:28.085656 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" event={"ID":"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94","Type":"ContainerStarted","Data":"f86e0a9b3e67885fe0ceedc082b5f09e8a0f1ab2bec647eea8eea9bb3bf5faf4"} Jul 13 04:11:29.094133 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:29.094088 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" event={"ID":"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94","Type":"ContainerStarted","Data":"952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c"} Jul 13 04:11:29.094537 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:29.094224 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:11:29.110995 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:29.110941 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" podStartSLOduration=2.377863137 podStartE2EDuration="4.110923363s" totalImagesPullingTime="1.733060226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:11:29.109746167 +0000 UTC m=+1819.720772965" watchObservedRunningTime="2026-07-13 04:11:29.110923363 +0000 UTC m=+1819.721950159" Jul 13 04:11:35.106154 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:11:35.106123 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:13:23.149596 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.149560 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2"] Jul 13 04:13:23.150089 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.149826 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" podUID="f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" containerName="maas-api" containerID="cri-o://952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c" gracePeriod=30 Jul 13 04:13:23.399047 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.399019 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:13:23.432570 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.432474 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72zr6\" (UniqueName: \"kubernetes.io/projected/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-kube-api-access-72zr6\") pod \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " Jul 13 04:13:23.432570 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.432535 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") pod \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " Jul 13 04:13:23.432570 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.432568 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-openshift-service-ca\") pod \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\" (UID: \"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94\") " Jul 13 04:13:23.432973 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.432946 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" (UID: "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 04:13:23.434579 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.434553 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-kube-api-access-72zr6" (OuterVolumeSpecName: "kube-api-access-72zr6") pod "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" (UID: "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94"). InnerVolumeSpecName "kube-api-access-72zr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:13:23.434915 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.434886 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" (UID: "f35a9afa-ed28-4f45-9cf2-6b30d7f14a94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 04:13:23.533323 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.533291 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72zr6\" (UniqueName: \"kubernetes.io/projected/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-kube-api-access-72zr6\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:13:23.533323 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.533319 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:13:23.533323 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.533328 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:13:23.679245 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.679211 2566 generic.go:356] "Generic (PLEG): container finished" podID="f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" containerID="952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c" exitCode=0 Jul 13 04:13:23.679420 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.679259 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" Jul 13 04:13:23.679420 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.679304 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" event={"ID":"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94","Type":"ContainerDied","Data":"952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c"} Jul 13 04:13:23.679420 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.679360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2" event={"ID":"f35a9afa-ed28-4f45-9cf2-6b30d7f14a94","Type":"ContainerDied","Data":"f86e0a9b3e67885fe0ceedc082b5f09e8a0f1ab2bec647eea8eea9bb3bf5faf4"} Jul 13 04:13:23.679420 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.679387 2566 scope.go:117] "RemoveContainer" containerID="952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c" Jul 13 04:13:23.689231 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.689213 2566 scope.go:117] "RemoveContainer" containerID="952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c" Jul 13 04:13:23.689506 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:13:23.689475 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c\": container with ID starting with 952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c not found: ID does not exist" containerID="952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c" Jul 13 04:13:23.689559 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.689517 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c"} err="failed to get container status \"952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c\": rpc error: code = NotFound desc = could not find container \"952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c\": container with ID starting with 952b9743276f81abef7fee8ef92536d8ecd1d64d0dd321b9232bf09f4f41d82c not found: ID does not exist" Jul 13 04:13:23.700572 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.700547 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2"] Jul 13 04:13:23.704616 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.704596 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-88358a-7dfd77664f-lldz2"] Jul 13 04:13:23.928738 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:23.928707 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" path="/var/lib/kubelet/pods/f35a9afa-ed28-4f45-9cf2-6b30d7f14a94/volumes" Jul 13 04:13:32.901498 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.901440 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw"] Jul 13 04:13:32.902005 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.901984 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" containerName="maas-api" Jul 13 04:13:32.902051 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.902010 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" containerName="maas-api" Jul 13 04:13:32.902134 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.902123 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f35a9afa-ed28-4f45-9cf2-6b30d7f14a94" containerName="maas-api" Jul 13 04:13:32.908186 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.908158 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:32.912091 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.912059 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5e78fc-serving-cert\"" Jul 13 04:13:32.912236 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.912044 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 04:13:32.912296 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.912282 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kd7hr\"" Jul 13 04:13:32.912651 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.912500 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 04:13:32.915659 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:32.915637 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw"] Jul 13 04:13:33.015015 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.014972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hx5\" (UniqueName: \"kubernetes.io/projected/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-kube-api-access-v9hx5\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.015188 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.015021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.015188 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.015043 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.116384 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.116345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hx5\" (UniqueName: \"kubernetes.io/projected/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-kube-api-access-v9hx5\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.116384 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.116387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.116677 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.116414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.116677 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:13:33.116573 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-serving-cert: secret "maas-api-e2e-api-a-5e78fc-serving-cert" not found Jul 13 04:13:33.116677 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:13:33.116660 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls podName:c8991f59-6e37-4c81-8ed3-d9b52ead45e9 nodeName:}" failed. No retries permitted until 2026-07-13 04:13:33.616628699 +0000 UTC m=+1944.227655494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls") pod "maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" (UID: "c8991f59-6e37-4c81-8ed3-d9b52ead45e9") : secret "maas-api-e2e-api-a-5e78fc-serving-cert" not found Jul 13 04:13:33.117149 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.117130 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-openshift-service-ca\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.128574 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.128551 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hx5\" (UniqueName: \"kubernetes.io/projected/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-kube-api-access-v9hx5\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.620882 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.620845 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.623344 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.623319 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls\") pod \"maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.822032 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.821996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:33.967862 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:33.967833 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw"] Jul 13 04:13:33.970197 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:13:33.970160 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8991f59_6e37_4c81_8ed3_d9b52ead45e9.slice/crio-f66169350b2c9e3a05870919ebf9e41956bfa93a8673370b4cf6edacdd4cee17 WatchSource:0}: Error finding container f66169350b2c9e3a05870919ebf9e41956bfa93a8673370b4cf6edacdd4cee17: Status 404 returned error can't find the container with id f66169350b2c9e3a05870919ebf9e41956bfa93a8673370b4cf6edacdd4cee17 Jul 13 04:13:34.734997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:34.734897 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" event={"ID":"c8991f59-6e37-4c81-8ed3-d9b52ead45e9","Type":"ContainerStarted","Data":"c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78"} Jul 13 04:13:34.734997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:34.734955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" event={"ID":"c8991f59-6e37-4c81-8ed3-d9b52ead45e9","Type":"ContainerStarted","Data":"f66169350b2c9e3a05870919ebf9e41956bfa93a8673370b4cf6edacdd4cee17"} Jul 13 04:13:34.734997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:34.734978 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:34.751705 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:34.751656 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" podStartSLOduration=2.298398511 podStartE2EDuration="2.751638891s" totalImagesPullingTime="453.24038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:13:34.750729623 +0000 UTC m=+1945.361756423" watchObservedRunningTime="2026-07-13 04:13:34.751638891 +0000 UTC m=+1945.362665701" Jul 13 04:13:40.745312 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:40.745283 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:40.950896 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:40.950859 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l"] Jul 13 04:13:40.955199 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:40.955172 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:40.957647 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:40.957623 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5c775a-serving-cert\"" Jul 13 04:13:40.962462 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:40.962414 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l"] Jul 13 04:13:41.081624 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.081588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8baa76-b5db-4944-bcf5-be729314568a-openshift-service-ca\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.081838 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.081661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-998c7\" (UniqueName: \"kubernetes.io/projected/7e8baa76-b5db-4944-bcf5-be729314568a-kube-api-access-998c7\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.081838 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.081788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.183078 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.183040 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-998c7\" (UniqueName: \"kubernetes.io/projected/7e8baa76-b5db-4944-bcf5-be729314568a-kube-api-access-998c7\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.183249 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.183095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.183249 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.183145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8baa76-b5db-4944-bcf5-be729314568a-openshift-service-ca\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.183334 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:13:41.183249 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-serving-cert: secret "maas-api-e2e-api-b-5c775a-serving-cert" not found Jul 13 04:13:41.183334 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:13:41.183315 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls podName:7e8baa76-b5db-4944-bcf5-be729314568a nodeName:}" failed. No retries permitted until 2026-07-13 04:13:41.683297001 +0000 UTC m=+1952.294323779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls") pod "maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" (UID: "7e8baa76-b5db-4944-bcf5-be729314568a") : secret "maas-api-e2e-api-b-5c775a-serving-cert" not found Jul 13 04:13:41.183765 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.183747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8baa76-b5db-4944-bcf5-be729314568a-openshift-service-ca\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.191503 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.191469 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-998c7\" (UniqueName: \"kubernetes.io/projected/7e8baa76-b5db-4944-bcf5-be729314568a-kube-api-access-998c7\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.689721 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.689685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.692177 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.692157 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls\") pod \"maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:41.870006 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:41.869974 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:42.010825 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:42.010799 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l"] Jul 13 04:13:42.012598 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:13:42.012570 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8baa76_b5db_4944_bcf5_be729314568a.slice/crio-832bbc86654be1b58830ad6a716cd7452f57dd82efeb9bcf40854217784b61d2 WatchSource:0}: Error finding container 832bbc86654be1b58830ad6a716cd7452f57dd82efeb9bcf40854217784b61d2: Status 404 returned error can't find the container with id 832bbc86654be1b58830ad6a716cd7452f57dd82efeb9bcf40854217784b61d2 Jul 13 04:13:42.784141 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:42.784106 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" event={"ID":"7e8baa76-b5db-4944-bcf5-be729314568a","Type":"ContainerStarted","Data":"6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107"} Jul 13 04:13:42.784417 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:42.784158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" event={"ID":"7e8baa76-b5db-4944-bcf5-be729314568a","Type":"ContainerStarted","Data":"832bbc86654be1b58830ad6a716cd7452f57dd82efeb9bcf40854217784b61d2"} Jul 13 04:13:42.784417 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:42.784199 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:42.799635 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:42.799577 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" podStartSLOduration=2.369105475 podStartE2EDuration="2.799558763s" totalImagesPullingTime="430.453288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:13:42.79868919 +0000 UTC m=+1953.409715987" watchObservedRunningTime="2026-07-13 04:13:42.799558763 +0000 UTC m=+1953.410585561" Jul 13 04:13:48.795714 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:48.795678 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:13:54.369541 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.369506 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw"] Jul 13 04:13:54.369962 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.369768 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" podUID="c8991f59-6e37-4c81-8ed3-d9b52ead45e9" containerName="maas-api" containerID="cri-o://c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78" gracePeriod=30 Jul 13 04:13:54.626866 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.626809 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:54.808861 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.808826 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9hx5\" (UniqueName: \"kubernetes.io/projected/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-kube-api-access-v9hx5\") pod \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " Jul 13 04:13:54.809041 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.808911 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls\") pod \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " Jul 13 04:13:54.809041 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.808971 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-openshift-service-ca\") pod \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\" (UID: \"c8991f59-6e37-4c81-8ed3-d9b52ead45e9\") " Jul 13 04:13:54.809380 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.809354 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8991f59-6e37-4c81-8ed3-d9b52ead45e9" (UID: "c8991f59-6e37-4c81-8ed3-d9b52ead45e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 04:13:54.811021 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.810992 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8991f59-6e37-4c81-8ed3-d9b52ead45e9" (UID: "c8991f59-6e37-4c81-8ed3-d9b52ead45e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 04:13:54.811234 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.811215 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-kube-api-access-v9hx5" (OuterVolumeSpecName: "kube-api-access-v9hx5") pod "c8991f59-6e37-4c81-8ed3-d9b52ead45e9" (UID: "c8991f59-6e37-4c81-8ed3-d9b52ead45e9"). InnerVolumeSpecName "kube-api-access-v9hx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:13:54.848145 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.848112 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8991f59-6e37-4c81-8ed3-d9b52ead45e9" containerID="c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78" exitCode=0 Jul 13 04:13:54.848258 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.848149 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" Jul 13 04:13:54.848258 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.848199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" event={"ID":"c8991f59-6e37-4c81-8ed3-d9b52ead45e9","Type":"ContainerDied","Data":"c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78"} Jul 13 04:13:54.848329 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.848263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw" event={"ID":"c8991f59-6e37-4c81-8ed3-d9b52ead45e9","Type":"ContainerDied","Data":"f66169350b2c9e3a05870919ebf9e41956bfa93a8673370b4cf6edacdd4cee17"} Jul 13 04:13:54.848329 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.848293 2566 scope.go:117] "RemoveContainer" containerID="c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78" Jul 13 04:13:54.857628 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.857610 2566 scope.go:117] "RemoveContainer" containerID="c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78" Jul 13 04:13:54.857889 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:13:54.857873 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78\": container with ID starting with c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78 not found: ID does not exist" containerID="c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78" Jul 13 04:13:54.857930 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.857898 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78"} err="failed to get container status \"c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78\": rpc error: code = NotFound desc = could not find container \"c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78\": container with ID starting with c2b31e82fa510b79a8920d0721022e38f8f8f07eac249fc4c6bd24dc03149d78 not found: ID does not exist" Jul 13 04:13:54.872127 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.872107 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw"] Jul 13 04:13:54.875789 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.875770 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5e78fc-5b49c75c76-8bjpw"] Jul 13 04:13:54.909968 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.909916 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9hx5\" (UniqueName: \"kubernetes.io/projected/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-kube-api-access-v9hx5\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:13:54.909968 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.909936 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:13:54.909968 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:54.909946 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8991f59-6e37-4c81-8ed3-d9b52ead45e9-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:13:55.929266 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:13:55.929229 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8991f59-6e37-4c81-8ed3-d9b52ead45e9" path="/var/lib/kubelet/pods/c8991f59-6e37-4c81-8ed3-d9b52ead45e9/volumes" Jul 13 04:14:00.908319 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:00.908279 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l"] Jul 13 04:14:00.908853 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:00.908562 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" podUID="7e8baa76-b5db-4944-bcf5-be729314568a" containerName="maas-api" containerID="cri-o://6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107" gracePeriod=30 Jul 13 04:14:01.150517 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.150478 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:14:01.162864 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.162812 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-998c7\" (UniqueName: \"kubernetes.io/projected/7e8baa76-b5db-4944-bcf5-be729314568a-kube-api-access-998c7\") pod \"7e8baa76-b5db-4944-bcf5-be729314568a\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " Jul 13 04:14:01.162864 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.162851 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8baa76-b5db-4944-bcf5-be729314568a-openshift-service-ca\") pod \"7e8baa76-b5db-4944-bcf5-be729314568a\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " Jul 13 04:14:01.162995 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.162881 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls\") pod \"7e8baa76-b5db-4944-bcf5-be729314568a\" (UID: \"7e8baa76-b5db-4944-bcf5-be729314568a\") " Jul 13 04:14:01.163184 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.163160 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8baa76-b5db-4944-bcf5-be729314568a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e8baa76-b5db-4944-bcf5-be729314568a" (UID: "7e8baa76-b5db-4944-bcf5-be729314568a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 04:14:01.164926 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.164892 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e8baa76-b5db-4944-bcf5-be729314568a" (UID: "7e8baa76-b5db-4944-bcf5-be729314568a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 04:14:01.165030 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.164944 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8baa76-b5db-4944-bcf5-be729314568a-kube-api-access-998c7" (OuterVolumeSpecName: "kube-api-access-998c7") pod "7e8baa76-b5db-4944-bcf5-be729314568a" (UID: "7e8baa76-b5db-4944-bcf5-be729314568a"). InnerVolumeSpecName "kube-api-access-998c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:14:01.263400 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.263362 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-998c7\" (UniqueName: \"kubernetes.io/projected/7e8baa76-b5db-4944-bcf5-be729314568a-kube-api-access-998c7\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:14:01.263400 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.263394 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e8baa76-b5db-4944-bcf5-be729314568a-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:14:01.263400 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.263406 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e8baa76-b5db-4944-bcf5-be729314568a-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:14:01.887263 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.887234 2566 generic.go:356] "Generic (PLEG): container finished" podID="7e8baa76-b5db-4944-bcf5-be729314568a" containerID="6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107" exitCode=0 Jul 13 04:14:01.887455 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.887268 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" event={"ID":"7e8baa76-b5db-4944-bcf5-be729314568a","Type":"ContainerDied","Data":"6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107"} Jul 13 04:14:01.887455 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.887281 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" Jul 13 04:14:01.887455 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.887309 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l" event={"ID":"7e8baa76-b5db-4944-bcf5-be729314568a","Type":"ContainerDied","Data":"832bbc86654be1b58830ad6a716cd7452f57dd82efeb9bcf40854217784b61d2"} Jul 13 04:14:01.887455 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.887330 2566 scope.go:117] "RemoveContainer" containerID="6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107" Jul 13 04:14:01.896566 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.896546 2566 scope.go:117] "RemoveContainer" containerID="6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107" Jul 13 04:14:01.896817 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:14:01.896797 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107\": container with ID starting with 6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107 not found: ID does not exist" containerID="6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107" Jul 13 04:14:01.896858 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.896825 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107"} err="failed to get container status \"6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107\": rpc error: code = NotFound desc = could not find container \"6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107\": container with ID starting with 6f9289da07cedb05a6ba276afa5bef36c9fec2fcab423b18a4805fd6156dd107 not found: ID does not exist" Jul 13 04:14:01.908325 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.908291 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l"] Jul 13 04:14:01.910276 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.910254 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c775a-5f4676f5bc-rns5l"] Jul 13 04:14:01.935247 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:01.935217 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8baa76-b5db-4944-bcf5-be729314568a" path="/var/lib/kubelet/pods/7e8baa76-b5db-4944-bcf5-be729314568a/volumes" Jul 13 04:14:10.115602 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.115564 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz"] Jul 13 04:14:10.115997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.115942 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8991f59-6e37-4c81-8ed3-d9b52ead45e9" containerName="maas-api" Jul 13 04:14:10.115997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.115954 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8991f59-6e37-4c81-8ed3-d9b52ead45e9" containerName="maas-api" Jul 13 04:14:10.115997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.115976 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8baa76-b5db-4944-bcf5-be729314568a" containerName="maas-api" Jul 13 04:14:10.115997 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.115982 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8baa76-b5db-4944-bcf5-be729314568a" containerName="maas-api" Jul 13 04:14:10.116179 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.116040 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8991f59-6e37-4c81-8ed3-d9b52ead45e9" containerName="maas-api" Jul 13 04:14:10.116179 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.116052 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8baa76-b5db-4944-bcf5-be729314568a" containerName="maas-api" Jul 13 04:14:10.120522 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.120499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.123079 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.123053 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-694c02-serving-cert\"" Jul 13 04:14:10.123229 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.123115 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 04:14:10.123229 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.123214 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kd7hr\"" Jul 13 04:14:10.124092 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.124077 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 04:14:10.124627 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.124607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhhf\" (UniqueName: \"kubernetes.io/projected/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-kube-api-access-xlhhf\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.124717 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.124683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.124777 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.124741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.130640 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.130616 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz"] Jul 13 04:14:10.225046 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.225015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.225220 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.225055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhhf\" (UniqueName: \"kubernetes.io/projected/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-kube-api-access-xlhhf\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.225220 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.225128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.225220 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:14:10.225168 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-serving-cert: secret "maas-api-e2e-shared-a-694c02-serving-cert" not found Jul 13 04:14:10.225361 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:14:10.225254 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls podName:f338b107-b6cf-4e08-a3ef-2adfa2d6031f nodeName:}" failed. No retries permitted until 2026-07-13 04:14:10.725230332 +0000 UTC m=+1981.336257120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls") pod "maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" (UID: "f338b107-b6cf-4e08-a3ef-2adfa2d6031f") : secret "maas-api-e2e-shared-a-694c02-serving-cert" not found Jul 13 04:14:10.225830 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.225809 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.237087 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.237061 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhhf\" (UniqueName: \"kubernetes.io/projected/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-kube-api-access-xlhhf\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.728743 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.728696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.731329 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.731304 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls\") pod \"maas-api-e2e-shared-a-694c02-fb564dbff-t82qz\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.733278 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.733181 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:10.879715 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.879688 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz"] Jul 13 04:14:10.881625 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:14:10.881584 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf338b107_b6cf_4e08_a3ef_2adfa2d6031f.slice/crio-84c2a01e233884d7c2d90b35717ecfcdb509f00fe743ffcebba484d83b16c19e WatchSource:0}: Error finding container 84c2a01e233884d7c2d90b35717ecfcdb509f00fe743ffcebba484d83b16c19e: Status 404 returned error can't find the container with id 84c2a01e233884d7c2d90b35717ecfcdb509f00fe743ffcebba484d83b16c19e Jul 13 04:14:10.935020 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:10.934983 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" event={"ID":"f338b107-b6cf-4e08-a3ef-2adfa2d6031f","Type":"ContainerStarted","Data":"84c2a01e233884d7c2d90b35717ecfcdb509f00fe743ffcebba484d83b16c19e"} Jul 13 04:14:11.941282 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:11.941183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" event={"ID":"f338b107-b6cf-4e08-a3ef-2adfa2d6031f","Type":"ContainerStarted","Data":"bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e"} Jul 13 04:14:11.941282 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:11.941259 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:11.957344 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:11.957289 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" podStartSLOduration=1.620511476 podStartE2EDuration="1.957272661s" totalImagesPullingTime="336.761185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:14:11.956318272 +0000 UTC m=+1982.567345069" watchObservedRunningTime="2026-07-13 04:14:11.957272661 +0000 UTC m=+1982.568299484" Jul 13 04:14:17.953646 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:17.953613 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:14:18.301771 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.301733 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp"] Jul 13 04:14:18.305374 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.305345 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.307740 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.307718 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-830ad7-serving-cert\"" Jul 13 04:14:18.315274 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.315246 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp"] Jul 13 04:14:18.396359 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.396325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwcdb\" (UniqueName: \"kubernetes.io/projected/38d00c21-8a68-40f8-8921-f4b0211ad553-kube-api-access-xwcdb\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.396582 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.396393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.396582 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.396463 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d00c21-8a68-40f8-8921-f4b0211ad553-openshift-service-ca\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.497848 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.497813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.498034 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.497856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d00c21-8a68-40f8-8921-f4b0211ad553-openshift-service-ca\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.498034 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.497904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwcdb\" (UniqueName: \"kubernetes.io/projected/38d00c21-8a68-40f8-8921-f4b0211ad553-kube-api-access-xwcdb\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.498034 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:14:18.497953 2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-serving-cert: secret "maas-api-e2e-shared-b-830ad7-serving-cert" not found Jul 13 04:14:18.498034 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:14:18.498036 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls podName:38d00c21-8a68-40f8-8921-f4b0211ad553 nodeName:}" failed. No retries permitted until 2026-07-13 04:14:18.998018368 +0000 UTC m=+1989.609045165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls") pod "maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" (UID: "38d00c21-8a68-40f8-8921-f4b0211ad553") : secret "maas-api-e2e-shared-b-830ad7-serving-cert" not found Jul 13 04:14:18.498640 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.498617 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d00c21-8a68-40f8-8921-f4b0211ad553-openshift-service-ca\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:18.509673 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:18.509644 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwcdb\" (UniqueName: \"kubernetes.io/projected/38d00c21-8a68-40f8-8921-f4b0211ad553-kube-api-access-xwcdb\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:19.002711 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:19.002672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:19.005294 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:19.005254 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls\") pod \"maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:19.219123 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:19.219083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:19.382087 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:19.382054 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp"] Jul 13 04:14:19.383241 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:14:19.383214 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d00c21_8a68_40f8_8921_f4b0211ad553.slice/crio-51c1da6c39ce37e4c36096c917a5962a2cffafca0adc374823b865a3ed1a55d2 WatchSource:0}: Error finding container 51c1da6c39ce37e4c36096c917a5962a2cffafca0adc374823b865a3ed1a55d2: Status 404 returned error can't find the container with id 51c1da6c39ce37e4c36096c917a5962a2cffafca0adc374823b865a3ed1a55d2 Jul 13 04:14:19.986374 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:19.986337 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" event={"ID":"38d00c21-8a68-40f8-8921-f4b0211ad553","Type":"ContainerStarted","Data":"51c1da6c39ce37e4c36096c917a5962a2cffafca0adc374823b865a3ed1a55d2"} Jul 13 04:14:20.992343 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:20.992302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" event={"ID":"38d00c21-8a68-40f8-8921-f4b0211ad553","Type":"ContainerStarted","Data":"7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317"} Jul 13 04:14:20.992767 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:20.992455 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:14:21.009665 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:21.009620 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" podStartSLOduration=2.384964486 podStartE2EDuration="3.009604465s" totalImagesPullingTime="624.639979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:14:21.007860223 +0000 UTC m=+1991.618887021" watchObservedRunningTime="2026-07-13 04:14:21.009604465 +0000 UTC m=+1991.620631261" Jul 13 04:14:27.003760 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:14:27.003725 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:15:00.136452 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.136413 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx"] Jul 13 04:15:00.140097 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.140078 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448"] Jul 13 04:15:00.140209 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.140191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:15:00.143118 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.143098 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:15:00.149156 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.149130 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx"] Jul 13 04:15:00.151878 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.151858 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448"] Jul 13 04:15:00.252299 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.252261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8xtj\" (UniqueName: \"kubernetes.io/projected/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4-kube-api-access-h8xtj\") pod \"maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx\" (UID: \"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:15:00.252299 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.252300 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfwbl\" (UniqueName: \"kubernetes.io/projected/e348aca7-a8da-4fa9-9c82-a731053c1178-kube-api-access-dfwbl\") pod \"maas-api-key-cleanup-29731935-sn448\" (UID: \"e348aca7-a8da-4fa9-9c82-a731053c1178\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:15:00.353302 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.353263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8xtj\" (UniqueName: \"kubernetes.io/projected/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4-kube-api-access-h8xtj\") pod \"maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx\" (UID: \"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:15:00.353302 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.353303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfwbl\" (UniqueName: \"kubernetes.io/projected/e348aca7-a8da-4fa9-9c82-a731053c1178-kube-api-access-dfwbl\") pod \"maas-api-key-cleanup-29731935-sn448\" (UID: \"e348aca7-a8da-4fa9-9c82-a731053c1178\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:15:00.361132 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.361098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8xtj\" (UniqueName: \"kubernetes.io/projected/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4-kube-api-access-h8xtj\") pod \"maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx\" (UID: \"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:15:00.361252 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.361163 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfwbl\" (UniqueName: \"kubernetes.io/projected/e348aca7-a8da-4fa9-9c82-a731053c1178-kube-api-access-dfwbl\") pod \"maas-api-key-cleanup-29731935-sn448\" (UID: \"e348aca7-a8da-4fa9-9c82-a731053c1178\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:15:00.452356 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.452279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:15:00.459969 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.459947 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:15:00.597301 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.597273 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx"] Jul 13 04:15:00.598995 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:15:00.598965 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf9ac4e_9d5f_4b7f_8b73_881cf4b51ad4.slice/crio-5a312fc822e8a2b7ca989dc2d3c1da1dd25b1a5fef8726ff3b86da9968c731c7 WatchSource:0}: Error finding container 5a312fc822e8a2b7ca989dc2d3c1da1dd25b1a5fef8726ff3b86da9968c731c7: Status 404 returned error can't find the container with id 5a312fc822e8a2b7ca989dc2d3c1da1dd25b1a5fef8726ff3b86da9968c731c7 Jul 13 04:15:00.622172 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:00.622151 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448"] Jul 13 04:15:00.632633 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:15:00.632603 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode348aca7_a8da_4fa9_9c82_a731053c1178.slice/crio-04405a747fdc82bb4687c0a6db8a7740058b208d1a1ac01d558cc6660f274695 WatchSource:0}: Error finding container 04405a747fdc82bb4687c0a6db8a7740058b208d1a1ac01d558cc6660f274695: Status 404 returned error can't find the container with id 04405a747fdc82bb4687c0a6db8a7740058b208d1a1ac01d558cc6660f274695 Jul 13 04:15:01.191905 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:01.191810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" event={"ID":"e348aca7-a8da-4fa9-9c82-a731053c1178","Type":"ContainerStarted","Data":"42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012"} Jul 13 04:15:01.191905 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:01.191868 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" event={"ID":"e348aca7-a8da-4fa9-9c82-a731053c1178","Type":"ContainerStarted","Data":"04405a747fdc82bb4687c0a6db8a7740058b208d1a1ac01d558cc6660f274695"} Jul 13 04:15:01.193327 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:01.193298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" event={"ID":"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4","Type":"ContainerStarted","Data":"5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb"} Jul 13 04:15:01.193448 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:01.193353 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" event={"ID":"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4","Type":"ContainerStarted","Data":"5a312fc822e8a2b7ca989dc2d3c1da1dd25b1a5fef8726ff3b86da9968c731c7"} Jul 13 04:15:01.207354 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:01.207203 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" podStartSLOduration=1.20718561 podStartE2EDuration="1.20718561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:15:01.206593716 +0000 UTC m=+2031.817620517" watchObservedRunningTime="2026-07-13 04:15:01.20718561 +0000 UTC m=+2031.818212407" Jul 13 04:15:01.224402 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:15:01.224356 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" podStartSLOduration=1.22434158 podStartE2EDuration="1.22434158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:15:01.222064934 +0000 UTC m=+2031.833091732" watchObservedRunningTime="2026-07-13 04:15:01.22434158 +0000 UTC m=+2031.835368378" Jul 13 04:16:00.011917 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:00.011829 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx"] Jul 13 04:16:00.012460 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:00.012044 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" podUID="fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" containerName="cleanup" containerID="cri-o://5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb" gracePeriod=30 Jul 13 04:16:00.014923 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:00.014893 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448"] Jul 13 04:16:00.015136 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:00.015098 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" podUID="e348aca7-a8da-4fa9-9c82-a731053c1178" containerName="cleanup" containerID="cri-o://42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012" gracePeriod=30 Jul 13 04:16:10.042429 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:10.042402 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:16:10.050772 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:10.050748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:16:10.050772 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:10.050760 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:16:10.055596 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:10.055579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4f6ms_969cc0b1-f0d3-48e9-9c93-3100c9d37e1d/ovn-acl-logging/0.log" Jul 13 04:16:30.225017 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.224984 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:16:30.228333 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.228312 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:16:30.333553 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.333435 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfwbl\" (UniqueName: \"kubernetes.io/projected/e348aca7-a8da-4fa9-9c82-a731053c1178-kube-api-access-dfwbl\") pod \"e348aca7-a8da-4fa9-9c82-a731053c1178\" (UID: \"e348aca7-a8da-4fa9-9c82-a731053c1178\") " Jul 13 04:16:30.333553 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.333498 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8xtj\" (UniqueName: \"kubernetes.io/projected/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4-kube-api-access-h8xtj\") pod \"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4\" (UID: \"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4\") " Jul 13 04:16:30.335578 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.335553 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4-kube-api-access-h8xtj" (OuterVolumeSpecName: "kube-api-access-h8xtj") pod "fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" (UID: "fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4"). InnerVolumeSpecName "kube-api-access-h8xtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:16:30.335678 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.335613 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e348aca7-a8da-4fa9-9c82-a731053c1178-kube-api-access-dfwbl" (OuterVolumeSpecName: "kube-api-access-dfwbl") pod "e348aca7-a8da-4fa9-9c82-a731053c1178" (UID: "e348aca7-a8da-4fa9-9c82-a731053c1178"). InnerVolumeSpecName "kube-api-access-dfwbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:16:30.435092 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.435044 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfwbl\" (UniqueName: \"kubernetes.io/projected/e348aca7-a8da-4fa9-9c82-a731053c1178-kube-api-access-dfwbl\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:16:30.435092 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.435088 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8xtj\" (UniqueName: \"kubernetes.io/projected/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4-kube-api-access-h8xtj\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:16:30.644859 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.644769 2566 generic.go:356] "Generic (PLEG): container finished" podID="e348aca7-a8da-4fa9-9c82-a731053c1178" containerID="42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012" exitCode=137 Jul 13 04:16:30.644859 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.644815 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" Jul 13 04:16:30.645079 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.644852 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" event={"ID":"e348aca7-a8da-4fa9-9c82-a731053c1178","Type":"ContainerDied","Data":"42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012"} Jul 13 04:16:30.645079 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.644915 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448" event={"ID":"e348aca7-a8da-4fa9-9c82-a731053c1178","Type":"ContainerDied","Data":"04405a747fdc82bb4687c0a6db8a7740058b208d1a1ac01d558cc6660f274695"} Jul 13 04:16:30.645079 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.644940 2566 scope.go:117] "RemoveContainer" containerID="42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012" Jul 13 04:16:30.646078 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.646058 2566 generic.go:356] "Generic (PLEG): container finished" podID="fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" containerID="5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb" exitCode=137 Jul 13 04:16:30.646178 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.646106 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" Jul 13 04:16:30.646178 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.646144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" event={"ID":"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4","Type":"ContainerDied","Data":"5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb"} Jul 13 04:16:30.646252 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.646184 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx" event={"ID":"fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4","Type":"ContainerDied","Data":"5a312fc822e8a2b7ca989dc2d3c1da1dd25b1a5fef8726ff3b86da9968c731c7"} Jul 13 04:16:30.653679 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.653663 2566 scope.go:117] "RemoveContainer" containerID="42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012" Jul 13 04:16:30.653951 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:16:30.653925 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012\": container with ID starting with 42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012 not found: ID does not exist" containerID="42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012" Jul 13 04:16:30.654003 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.653963 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012"} err="failed to get container status \"42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012\": rpc error: code = NotFound desc = could not find container \"42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012\": container with ID starting with 42c26304f87cdee522876f0f325026898c846c69996c8bf1a62a81c48d2b6012 not found: ID does not exist" Jul 13 04:16:30.654003 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.653987 2566 scope.go:117] "RemoveContainer" containerID="5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb" Jul 13 04:16:30.661775 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.661760 2566 scope.go:117] "RemoveContainer" containerID="5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb" Jul 13 04:16:30.662016 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:16:30.661999 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb\": container with ID starting with 5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb not found: ID does not exist" containerID="5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb" Jul 13 04:16:30.662076 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.662023 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb"} err="failed to get container status \"5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb\": rpc error: code = NotFound desc = could not find container \"5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb\": container with ID starting with 5ad8c19b84d9827b15666b9cd54a12a060de8850c7c1597d36b51d20034555cb not found: ID does not exist" Jul 13 04:16:30.670509 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.670475 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448"] Jul 13 04:16:30.674134 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.674116 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731935-sn448"] Jul 13 04:16:30.683651 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.683628 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx"] Jul 13 04:16:30.687367 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:30.687344 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-694c02-29731935-prwhx"] Jul 13 04:16:31.928993 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:31.928957 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e348aca7-a8da-4fa9-9c82-a731053c1178" path="/var/lib/kubelet/pods/e348aca7-a8da-4fa9-9c82-a731053c1178/volumes" Jul 13 04:16:31.929369 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:16:31.929317 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" path="/var/lib/kubelet/pods/fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4/volumes" Jul 13 04:17:28.269425 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.269385 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz"] Jul 13 04:17:28.270351 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.269658 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" podUID="f338b107-b6cf-4e08-a3ef-2adfa2d6031f" containerName="maas-api" containerID="cri-o://bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e" gracePeriod=30 Jul 13 04:17:28.522469 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.522405 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:17:28.645716 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.645682 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls\") pod \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " Jul 13 04:17:28.645716 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.645722 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-openshift-service-ca\") pod \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " Jul 13 04:17:28.645926 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.645901 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlhhf\" (UniqueName: \"kubernetes.io/projected/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-kube-api-access-xlhhf\") pod \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\" (UID: \"f338b107-b6cf-4e08-a3ef-2adfa2d6031f\") " Jul 13 04:17:28.646064 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.646026 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f338b107-b6cf-4e08-a3ef-2adfa2d6031f" (UID: "f338b107-b6cf-4e08-a3ef-2adfa2d6031f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 04:17:28.646201 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.646186 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:17:28.647859 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.647837 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-kube-api-access-xlhhf" (OuterVolumeSpecName: "kube-api-access-xlhhf") pod "f338b107-b6cf-4e08-a3ef-2adfa2d6031f" (UID: "f338b107-b6cf-4e08-a3ef-2adfa2d6031f"). InnerVolumeSpecName "kube-api-access-xlhhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:17:28.647965 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.647944 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f338b107-b6cf-4e08-a3ef-2adfa2d6031f" (UID: "f338b107-b6cf-4e08-a3ef-2adfa2d6031f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 04:17:28.746960 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.746926 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlhhf\" (UniqueName: \"kubernetes.io/projected/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-kube-api-access-xlhhf\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:17:28.746960 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.746957 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f338b107-b6cf-4e08-a3ef-2adfa2d6031f-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:17:28.947200 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.947103 2566 generic.go:356] "Generic (PLEG): container finished" podID="f338b107-b6cf-4e08-a3ef-2adfa2d6031f" containerID="bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e" exitCode=0 Jul 13 04:17:28.947200 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.947147 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" Jul 13 04:17:28.947391 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.947191 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" event={"ID":"f338b107-b6cf-4e08-a3ef-2adfa2d6031f","Type":"ContainerDied","Data":"bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e"} Jul 13 04:17:28.947391 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.947249 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz" event={"ID":"f338b107-b6cf-4e08-a3ef-2adfa2d6031f","Type":"ContainerDied","Data":"84c2a01e233884d7c2d90b35717ecfcdb509f00fe743ffcebba484d83b16c19e"} Jul 13 04:17:28.947391 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.947278 2566 scope.go:117] "RemoveContainer" containerID="bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e" Jul 13 04:17:28.956874 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.956857 2566 scope.go:117] "RemoveContainer" containerID="bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e" Jul 13 04:17:28.957132 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:17:28.957112 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e\": container with ID starting with bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e not found: ID does not exist" containerID="bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e" Jul 13 04:17:28.957194 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.957139 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e"} err="failed to get container status \"bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e\": rpc error: code = NotFound desc = could not find container \"bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e\": container with ID starting with bc0486703c4acfafada0433f4a770777ca0809238fb63d960e74f04304bdb91e not found: ID does not exist" Jul 13 04:17:28.969090 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.969067 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz"] Jul 13 04:17:28.971998 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:28.971975 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-694c02-fb564dbff-t82qz"] Jul 13 04:17:29.928894 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:29.928858 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f338b107-b6cf-4e08-a3ef-2adfa2d6031f" path="/var/lib/kubelet/pods/f338b107-b6cf-4e08-a3ef-2adfa2d6031f/volumes" Jul 13 04:17:35.054318 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.054283 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp"] Jul 13 04:17:35.054804 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.054543 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" podUID="38d00c21-8a68-40f8-8921-f4b0211ad553" containerName="maas-api" containerID="cri-o://7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317" gracePeriod=30 Jul 13 04:17:35.307769 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.307709 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:17:35.403105 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.403069 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwcdb\" (UniqueName: \"kubernetes.io/projected/38d00c21-8a68-40f8-8921-f4b0211ad553-kube-api-access-xwcdb\") pod \"38d00c21-8a68-40f8-8921-f4b0211ad553\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " Jul 13 04:17:35.403299 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.403126 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d00c21-8a68-40f8-8921-f4b0211ad553-openshift-service-ca\") pod \"38d00c21-8a68-40f8-8921-f4b0211ad553\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " Jul 13 04:17:35.403368 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.403293 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls\") pod \"38d00c21-8a68-40f8-8921-f4b0211ad553\" (UID: \"38d00c21-8a68-40f8-8921-f4b0211ad553\") " Jul 13 04:17:35.403522 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.403472 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d00c21-8a68-40f8-8921-f4b0211ad553-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38d00c21-8a68-40f8-8921-f4b0211ad553" (UID: "38d00c21-8a68-40f8-8921-f4b0211ad553"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 04:17:35.405168 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.405145 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d00c21-8a68-40f8-8921-f4b0211ad553-kube-api-access-xwcdb" (OuterVolumeSpecName: "kube-api-access-xwcdb") pod "38d00c21-8a68-40f8-8921-f4b0211ad553" (UID: "38d00c21-8a68-40f8-8921-f4b0211ad553"). InnerVolumeSpecName "kube-api-access-xwcdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 04:17:35.405277 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.405258 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38d00c21-8a68-40f8-8921-f4b0211ad553" (UID: "38d00c21-8a68-40f8-8921-f4b0211ad553"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 04:17:35.504893 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.504860 2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d00c21-8a68-40f8-8921-f4b0211ad553-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:17:35.504893 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.504888 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwcdb\" (UniqueName: \"kubernetes.io/projected/38d00c21-8a68-40f8-8921-f4b0211ad553-kube-api-access-xwcdb\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:17:35.504893 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.504898 2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d00c21-8a68-40f8-8921-f4b0211ad553-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 13 04:17:35.983910 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.983873 2566 generic.go:356] "Generic (PLEG): container finished" podID="38d00c21-8a68-40f8-8921-f4b0211ad553" containerID="7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317" exitCode=0 Jul 13 04:17:35.984061 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.983919 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" Jul 13 04:17:35.984061 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.983942 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" event={"ID":"38d00c21-8a68-40f8-8921-f4b0211ad553","Type":"ContainerDied","Data":"7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317"} Jul 13 04:17:35.984061 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.983989 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp" event={"ID":"38d00c21-8a68-40f8-8921-f4b0211ad553","Type":"ContainerDied","Data":"51c1da6c39ce37e4c36096c917a5962a2cffafca0adc374823b865a3ed1a55d2"} Jul 13 04:17:35.984061 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.984012 2566 scope.go:117] "RemoveContainer" containerID="7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317" Jul 13 04:17:35.992938 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.992920 2566 scope.go:117] "RemoveContainer" containerID="7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317" Jul 13 04:17:35.993181 ip-10-0-138-160 kubenswrapper[2566]: E0713 04:17:35.993164 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317\": container with ID starting with 7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317 not found: ID does not exist" containerID="7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317" Jul 13 04:17:35.993253 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:35.993189 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317"} err="failed to get container status \"7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317\": rpc error: code = NotFound desc = could not find container \"7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317\": container with ID starting with 7a23661d0b58e9b7e80224d28f7717cca76a40e319aa54ff66001dcb92d98317 not found: ID does not exist" Jul 13 04:17:36.000376 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:36.000327 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp"] Jul 13 04:17:36.002472 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:36.002452 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-830ad7-566b8b44cc-l9bvp"] Jul 13 04:17:37.928858 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:37.928823 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d00c21-8a68-40f8-8921-f4b0211ad553" path="/var/lib/kubelet/pods/38d00c21-8a68-40f8-8921-f4b0211ad553/volumes" Jul 13 04:17:45.998322 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:45.998288 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59f8b857c-gfw8n_6f941cd2-078a-4279-b00d-879a7ae486d0/manager/0.log" Jul 13 04:17:46.462342 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:46.462308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-s45gg_be3ac418-6031-4a07-aa96-b42cf3982439/manager/0.log" Jul 13 04:17:46.469505 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:46.469471 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-s45gg_be3ac418-6031-4a07-aa96-b42cf3982439/copy-manifests/0.log" Jul 13 04:17:47.337890 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.337861 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf_1a77d927-b889-4307-be07-a2fe0bf2d9e0/extract/0.log" Jul 13 04:17:47.344120 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.344093 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf_1a77d927-b889-4307-be07-a2fe0bf2d9e0/util/0.log" Jul 13 04:17:47.350684 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.350662 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf_1a77d927-b889-4307-be07-a2fe0bf2d9e0/pull/0.log" Jul 13 04:17:47.462792 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.462741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp_0ca0bcaa-ce66-45af-b007-72518c14b7ea/pull/0.log" Jul 13 04:17:47.468677 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.468652 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp_0ca0bcaa-ce66-45af-b007-72518c14b7ea/extract/0.log" Jul 13 04:17:47.474286 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.474265 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp_0ca0bcaa-ce66-45af-b007-72518c14b7ea/util/0.log" Jul 13 04:17:47.580721 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.580691 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7_a59541cc-a42c-469d-ba21-f07624fe8466/util/0.log" Jul 13 04:17:47.586652 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.586628 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7_a59541cc-a42c-469d-ba21-f07624fe8466/pull/0.log" Jul 13 04:17:47.594505 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.594405 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7_a59541cc-a42c-469d-ba21-f07624fe8466/extract/0.log" Jul 13 04:17:47.706357 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.706330 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt_5e309cb0-9eab-4b21-8611-9e35ff27907d/util/0.log" Jul 13 04:17:47.712691 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.712671 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt_5e309cb0-9eab-4b21-8611-9e35ff27907d/pull/0.log" Jul 13 04:17:47.718875 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:47.718853 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt_5e309cb0-9eab-4b21-8611-9e35ff27907d/extract/0.log" Jul 13 04:17:48.420551 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:48.420523 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cwsbc_f4adbf47-3b45-4666-aaca-473181a9284c/manager/0.log" Jul 13 04:17:49.115207 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:49.115178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8hmgs_feca5bba-fed8-4d9e-b1ea-4adc10113e35/discovery/0.log" Jul 13 04:17:49.565451 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:49.565420 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5zjrz_1daf5fc4-a51c-4cff-b183-b52dfaec783b/payload-pre-processing/0.log" Jul 13 04:17:49.674283 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:49.674246 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qhmvq_083e75aa-150c-4d8b-a29e-9b5ea9656940/payload-processing/0.log" Jul 13 04:17:49.789753 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:49.789725 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75849b74f4-57j5n_c7d08be5-f84e-45ef-8af3-be89af94bef4/router/0.log" Jul 13 04:17:50.256975 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:50.256950 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fljts_8bd48768-d656-420e-8b54-658192b5477a/main/0.log" Jul 13 04:17:58.158541 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:58.158506 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rxgxc_a9b72b47-ed1e-466e-bafb-9069b5d4e30a/global-pull-secret-syncer/0.log" Jul 13 04:17:58.235155 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:58.235125 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8cmxg_f7a47283-9c9e-4392-9726-4c554c3a2ba8/konnectivity-agent/0.log" Jul 13 04:17:58.319635 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:17:58.319604 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-160.ec2.internal_8997424ab9ede1966bb41bf6bb742766/haproxy/0.log" Jul 13 04:18:03.101402 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.101371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf_1a77d927-b889-4307-be07-a2fe0bf2d9e0/extract/0.log" Jul 13 04:18:03.125451 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.125422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf_1a77d927-b889-4307-be07-a2fe0bf2d9e0/util/0.log" Jul 13 04:18:03.149397 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.149373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594sxgf_1a77d927-b889-4307-be07-a2fe0bf2d9e0/pull/0.log" Jul 13 04:18:03.181357 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.181326 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp_0ca0bcaa-ce66-45af-b007-72518c14b7ea/extract/0.log" Jul 13 04:18:03.212773 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.212742 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp_0ca0bcaa-ce66-45af-b007-72518c14b7ea/util/0.log" Jul 13 04:18:03.235795 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.235769 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0slkfp_0ca0bcaa-ce66-45af-b007-72518c14b7ea/pull/0.log" Jul 13 04:18:03.265885 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.265869 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7_a59541cc-a42c-469d-ba21-f07624fe8466/extract/0.log" Jul 13 04:18:03.287378 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.287351 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7_a59541cc-a42c-469d-ba21-f07624fe8466/util/0.log" Jul 13 04:18:03.318258 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.318232 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wl4p7_a59541cc-a42c-469d-ba21-f07624fe8466/pull/0.log" Jul 13 04:18:03.340989 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.340963 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt_5e309cb0-9eab-4b21-8611-9e35ff27907d/extract/0.log" Jul 13 04:18:03.363544 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.363464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt_5e309cb0-9eab-4b21-8611-9e35ff27907d/util/0.log" Jul 13 04:18:03.386463 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.386441 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18rtpt_5e309cb0-9eab-4b21-8611-9e35ff27907d/pull/0.log" Jul 13 04:18:03.908694 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:03.908664 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cwsbc_f4adbf47-3b45-4666-aaca-473181a9284c/manager/0.log" Jul 13 04:18:06.074359 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:06.074328 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-x8v78_2589615c-36ca-464a-871e-f69e74cfb2f7/cluster-monitoring-operator/0.log" Jul 13 04:18:06.315689 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:06.315663 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gncrt_ac4fed05-c85c-4de1-890d-a7c91dd2d1ba/node-exporter/0.log" Jul 13 04:18:06.337231 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:06.337168 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gncrt_ac4fed05-c85c-4de1-890d-a7c91dd2d1ba/kube-rbac-proxy/0.log" Jul 13 04:18:06.358151 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:06.358130 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gncrt_ac4fed05-c85c-4de1-890d-a7c91dd2d1ba/init-textfile/0.log" Jul 13 04:18:06.759735 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:06.759709 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-jtk2m_82cca265-b128-4084-a9fa-18c4998b9a71/prometheus-operator-admission-webhook/0.log" Jul 13 04:18:08.163737 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.163708 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-rlgcr_11807f63-2cb3-46cf-9b11-23b24265ab75/networking-console-plugin/0.log" Jul 13 04:18:08.566281 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566253 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69"] Jul 13 04:18:08.566686 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566651 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d00c21-8a68-40f8-8921-f4b0211ad553" containerName="maas-api" Jul 13 04:18:08.566686 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566667 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d00c21-8a68-40f8-8921-f4b0211ad553" containerName="maas-api" Jul 13 04:18:08.566686 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566683 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e348aca7-a8da-4fa9-9c82-a731053c1178" containerName="cleanup" Jul 13 04:18:08.566686 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566689 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e348aca7-a8da-4fa9-9c82-a731053c1178" containerName="cleanup" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566698 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" containerName="cleanup" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566705 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" containerName="cleanup" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566754 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f338b107-b6cf-4e08-a3ef-2adfa2d6031f" containerName="maas-api" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566765 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f338b107-b6cf-4e08-a3ef-2adfa2d6031f" containerName="maas-api" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566879 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf9ac4e-9d5f-4b7f-8b73-881cf4b51ad4" containerName="cleanup" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566892 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e348aca7-a8da-4fa9-9c82-a731053c1178" containerName="cleanup" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566903 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d00c21-8a68-40f8-8921-f4b0211ad553" containerName="maas-api" Jul 13 04:18:08.566959 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.566914 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f338b107-b6cf-4e08-a3ef-2adfa2d6031f" containerName="maas-api" Jul 13 04:18:08.569956 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.569936 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.572475 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.572451 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvgg\"/\"openshift-service-ca.crt\"" Jul 13 04:18:08.572475 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.572470 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvgg\"/\"kube-root-ca.crt\"" Jul 13 04:18:08.572650 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.572518 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpvgg\"/\"default-dockercfg-k7b9k\"" Jul 13 04:18:08.579700 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.579638 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69"] Jul 13 04:18:08.685038 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.685003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-lib-modules\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.685230 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.685042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4hk\" (UniqueName: \"kubernetes.io/projected/844be252-2a67-4552-93a3-50c5a92d17bc-kube-api-access-ft4hk\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.685230 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.685132 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-podres\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.685230 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.685162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-sys\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.685230 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.685197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-proc\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786236 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786204 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-podres\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786236 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786240 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-sys\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786473 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-proc\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786473 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-lib-modules\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786473 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4hk\" (UniqueName: \"kubernetes.io/projected/844be252-2a67-4552-93a3-50c5a92d17bc-kube-api-access-ft4hk\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786473 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-sys\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786473 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786375 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-podres\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786473 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786408 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-proc\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.786701 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.786511 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/844be252-2a67-4552-93a3-50c5a92d17bc-lib-modules\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.793932 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.793902 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4hk\" (UniqueName: \"kubernetes.io/projected/844be252-2a67-4552-93a3-50c5a92d17bc-kube-api-access-ft4hk\") pod \"perf-node-gather-daemonset-k5x69\" (UID: \"844be252-2a67-4552-93a3-50c5a92d17bc\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:08.822559 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.822500 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/1.log" Jul 13 04:18:08.827722 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.827694 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ls5tw_1678db10-807b-4022-a8a5-23156692eb49/console-operator/2.log" Jul 13 04:18:08.880895 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:08.880862 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:09.017716 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:09.017688 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69"] Jul 13 04:18:09.019534 ip-10-0-138-160 kubenswrapper[2566]: W0713 04:18:09.019502 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod844be252_2a67_4552_93a3_50c5a92d17bc.slice/crio-c881a1a9df4028eef8e4c5badd93540dd50a496f8fee144a3917bd9397a37628 WatchSource:0}: Error finding container c881a1a9df4028eef8e4c5badd93540dd50a496f8fee144a3917bd9397a37628: Status 404 returned error can't find the container with id c881a1a9df4028eef8e4c5badd93540dd50a496f8fee144a3917bd9397a37628 Jul 13 04:18:09.159505 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:09.159449 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" event={"ID":"844be252-2a67-4552-93a3-50c5a92d17bc","Type":"ContainerStarted","Data":"8e500cfd4b20a33c4b2a2f73af2a36a6462dca356dd9b31d080af95657668429"} Jul 13 04:18:09.159617 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:09.159525 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" event={"ID":"844be252-2a67-4552-93a3-50c5a92d17bc","Type":"ContainerStarted","Data":"c881a1a9df4028eef8e4c5badd93540dd50a496f8fee144a3917bd9397a37628"} Jul 13 04:18:09.159617 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:09.159554 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:09.176312 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:09.176262 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" podStartSLOduration=1.176222574 podStartE2EDuration="1.176222574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 04:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:18:09.175441254 +0000 UTC m=+2219.786468053" watchObservedRunningTime="2026-07-13 04:18:09.176222574 +0000 UTC m=+2219.787249371" Jul 13 04:18:09.989398 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:09.989372 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-c4kwt_d66efce8-7b87-4ba9-a323-64982e55f9e1/volume-data-source-validator/0.log" Jul 13 04:18:11.102002 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:11.101964 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kw4gq_26698947-2633-48e2-b49c-26595c53eafd/dns/0.log" Jul 13 04:18:11.121827 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:11.121803 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kw4gq_26698947-2633-48e2-b49c-26595c53eafd/kube-rbac-proxy/0.log" Jul 13 04:18:11.214173 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:11.214135 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sb8vh_1f169a86-02b5-4edb-82fe-991e59579698/dns-node-resolver/0.log" Jul 13 04:18:11.781036 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:11.781008 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-twp2d_43fd49e6-f97a-4eb3-91d0-8ed2a0e04441/node-ca/0.log" Jul 13 04:18:12.826683 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:12.826635 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8hmgs_feca5bba-fed8-4d9e-b1ea-4adc10113e35/discovery/0.log" Jul 13 04:18:12.966915 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:12.966884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5zjrz_1daf5fc4-a51c-4cff-b183-b52dfaec783b/payload-pre-processing/0.log" Jul 13 04:18:13.015367 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:13.015340 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qhmvq_083e75aa-150c-4d8b-a29e-9b5ea9656940/payload-processing/0.log" Jul 13 04:18:13.036559 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:13.036529 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75849b74f4-57j5n_c7d08be5-f84e-45ef-8af3-be89af94bef4/router/0.log" Jul 13 04:18:13.740226 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:13.740197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sc6nq_dbf5a046-4748-4afc-a098-67de1582b9ff/serve-healthcheck-canary/0.log" Jul 13 04:18:14.192803 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:14.192758 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jr4xz_fc207ea4-221c-4cc7-9172-ccb65cd7bed7/insights-operator/0.log" Jul 13 04:18:14.193424 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:14.193299 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jr4xz_fc207ea4-221c-4cc7-9172-ccb65cd7bed7/insights-operator/1.log" Jul 13 04:18:14.343985 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:14.343944 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rd622_ac11700e-0003-4782-8236-0f2462eb7203/kube-rbac-proxy/0.log" Jul 13 04:18:14.364074 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:14.364050 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rd622_ac11700e-0003-4782-8236-0f2462eb7203/exporter/0.log" Jul 13 04:18:14.384201 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:14.384173 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rd622_ac11700e-0003-4782-8236-0f2462eb7203/extractor/0.log" Jul 13 04:18:15.174592 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:15.174563 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-k5x69" Jul 13 04:18:16.903676 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:16.903643 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59f8b857c-gfw8n_6f941cd2-078a-4279-b00d-879a7ae486d0/manager/0.log" Jul 13 04:18:17.102914 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:17.102881 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-s45gg_be3ac418-6031-4a07-aa96-b42cf3982439/manager/0.log" Jul 13 04:18:17.122978 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:17.122951 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-s45gg_be3ac418-6031-4a07-aa96-b42cf3982439/copy-manifests/0.log" Jul 13 04:18:18.469941 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:18.469910 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c9556dbfd-rhcnv_85a0970a-3c09-4226-a153-166c801fc275/manager/0.log" Jul 13 04:18:20.038019 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:20.037986 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8hmgs_feca5bba-fed8-4d9e-b1ea-4adc10113e35/discovery/0.log" Jul 13 04:18:20.142830 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:20.142800 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5zjrz_1daf5fc4-a51c-4cff-b183-b52dfaec783b/payload-pre-processing/0.log" Jul 13 04:18:20.182363 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:20.182339 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qhmvq_083e75aa-150c-4d8b-a29e-9b5ea9656940/payload-processing/0.log" Jul 13 04:18:20.197826 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:20.197791 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75849b74f4-57j5n_c7d08be5-f84e-45ef-8af3-be89af94bef4/router/0.log" Jul 13 04:18:21.593683 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:21.593650 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8hmgs_feca5bba-fed8-4d9e-b1ea-4adc10113e35/discovery/0.log" Jul 13 04:18:21.705007 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:21.704980 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-5zjrz_1daf5fc4-a51c-4cff-b183-b52dfaec783b/payload-pre-processing/0.log" Jul 13 04:18:21.748634 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:21.748514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qhmvq_083e75aa-150c-4d8b-a29e-9b5ea9656940/payload-processing/0.log" Jul 13 04:18:21.769053 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:21.769031 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75849b74f4-57j5n_c7d08be5-f84e-45ef-8af3-be89af94bef4/router/0.log" Jul 13 04:18:23.601931 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:23.601880 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fgbx5_3e799dbc-f3b9-42a7-a09e-ca9e338e0c24/migrator/0.log" Jul 13 04:18:23.621698 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:23.621673 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fgbx5_3e799dbc-f3b9-42a7-a09e-ca9e338e0c24/graceful-termination/0.log" Jul 13 04:18:23.957648 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:23.957614 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xpq6d_b9d5eb82-345f-4b31-9dfc-a99144942c32/kube-storage-version-migrator-operator/1.log" Jul 13 04:18:23.958589 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:23.958563 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xpq6d_b9d5eb82-345f-4b31-9dfc-a99144942c32/kube-storage-version-migrator-operator/0.log" Jul 13 04:18:25.000890 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.000857 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/kube-multus-additional-cni-plugins/0.log" Jul 13 04:18:25.036653 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.036621 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/egress-router-binary-copy/0.log" Jul 13 04:18:25.076589 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.076564 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/cni-plugins/0.log" Jul 13 04:18:25.110556 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.110534 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/bond-cni-plugin/0.log" Jul 13 04:18:25.153634 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.153611 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/routeoverride-cni/0.log" Jul 13 04:18:25.192601 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.192575 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/whereabouts-cni-bincopy/0.log" Jul 13 04:18:25.230665 ip-10-0-138-160 kubenswrapper[2566]: I0713 04:18:25.230639 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhf7m_b9ebce7a-2727-48af-ad6a-17e26c8eada0/whereabouts-cni/0.log"