Jul 16 12:39:16.971215 ip-10-0-143-248 systemd[1]: Starting Kubernetes Kubelet... Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.379044 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383401 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383413 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383417 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383420 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383424 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383428 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383431 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:39:17.387340 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383434 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383437 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383439 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383442 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383445 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383447 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383450 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383452 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383455 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383458 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383460 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383463 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383466 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383472 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383477 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383480 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383484 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383487 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383490 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:39:17.388204 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383493 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383497 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383500 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383503 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383506 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383509 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383512 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383514 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383516 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383519 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383521 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383524 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383527 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383530 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383533 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383535 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383538 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383542 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383544 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383548 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:39:17.388843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383551 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383554 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383557 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383559 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383562 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383564 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383568 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383570 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383573 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383575 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383578 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383580 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383583 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383586 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383588 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383590 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383594 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383596 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383601 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383605 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:39:17.389507 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383607 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383610 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383613 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383615 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383618 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383621 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383625 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383628 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383631 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383633 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383636 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383638 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383641 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383644 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383646 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383649 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383653 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383655 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383658 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:39:17.390165 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383660 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383663 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383666 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383668 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383671 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383673 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383676 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383679 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383681 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383684 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383686 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383689 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383692 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.383695 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384466 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384475 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384479 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384483 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384486 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384490 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:39:17.390846 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384493 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384496 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384499 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384501 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384504 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384507 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384510 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384512 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384514 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384517 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384519 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384522 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384525 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384527 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384529 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384532 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384534 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384537 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384539 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384541 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:39:17.391487 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384544 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384546 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384549 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384551 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384554 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384557 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384560 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384562 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384565 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384568 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384570 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384573 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384576 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384579 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384584 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384587 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384590 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384593 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384595 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384598 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:39:17.392133 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384601 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384604 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384607 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384609 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384613 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384616 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384619 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384622 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384624 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384627 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384629 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384632 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384634 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384637 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384639 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384642 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384644 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384647 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384651 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:39:17.392758 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384653 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384656 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384658 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384661 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384663 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384666 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384669 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384671 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384674 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384676 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384679 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384681 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384683 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384686 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384689 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384692 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384694 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384697 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384702 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384705 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:39:17.393417 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384707 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384709 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384712 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384714 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384717 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384720 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384723 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384725 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384727 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384730 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384733 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384735 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384738 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.384740 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385728 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385735 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385739 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385741 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385745 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385747 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:39:17.394239 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385750 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385753 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385756 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385759 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385761 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385764 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385767 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385769 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385772 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385774 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385781 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385784 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385787 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385790 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385792 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385797 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385800 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385803 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385806 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385809 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:39:17.394880 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385812 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385816 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385820 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385823 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385826 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385829 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385832 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385834 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385837 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385840 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385843 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385852 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385855 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385858 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385861 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385863 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385868 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385871 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385873 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:39:17.395746 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385876 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385879 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385881 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385900 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385904 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385906 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385909 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385911 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385914 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385917 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385919 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385922 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385924 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385927 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385929 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385933 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385936 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385938 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385941 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385944 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:39:17.396625 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385947 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385950 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385952 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385955 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385957 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385961 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385964 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385967 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385969 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385972 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385974 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385976 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385979 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385981 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385984 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385987 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385990 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385993 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385995 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:39:17.397261 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.385998 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386001 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386003 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386005 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386008 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386011 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386013 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386016 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386035 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386040 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386043 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386046 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386049 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386052 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386054 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386120 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386127 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386148 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386153 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386160 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386164 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 12:39:17.397918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386168 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386172 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386176 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386179 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386182 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386185 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386189 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386194 2567 flags.go:64] FLAG: --cgroup-root="" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386196 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386199 2567 flags.go:64] FLAG: --client-ca-file="" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386202 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386205 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386210 2567 flags.go:64] FLAG: --cluster-domain="" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386213 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386216 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386219 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386223 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386226 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386229 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386234 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386237 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386240 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386244 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386247 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 12:39:17.398541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386250 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386253 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386257 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386260 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386263 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386266 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386269 2567 flags.go:64] FLAG: --enable-server="true" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386273 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386278 2567 flags.go:64] FLAG: --event-burst="100" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386281 2567 flags.go:64] FLAG: --event-qps="50" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386284 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386287 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386290 2567 flags.go:64] FLAG: --eviction-hard="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386294 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386296 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386301 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386304 2567 flags.go:64] FLAG: --eviction-soft="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386307 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386310 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386313 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386316 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386318 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386321 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386324 2567 flags.go:64] FLAG: --feature-gates="" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386328 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 12:39:17.399182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386331 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386334 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386339 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386342 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386345 2567 flags.go:64] FLAG: --help="false" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386348 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-248.ec2.internal" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386351 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386354 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386357 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386360 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386363 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386366 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386369 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386372 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386375 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386378 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386382 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386385 2567 flags.go:64] FLAG: --kube-reserved="" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386388 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386391 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386394 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386397 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386401 2567 flags.go:64] FLAG: --lock-file="" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386404 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 12:39:17.400247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386407 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386410 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386415 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386418 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386421 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386424 2567 flags.go:64] FLAG: --logging-format="text" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386426 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386430 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386432 2567 flags.go:64] FLAG: --manifest-url="" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386435 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386441 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386445 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386448 2567 flags.go:64] FLAG: --max-pods="110" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386451 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386454 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386457 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386460 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386463 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386467 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386469 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386477 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386480 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386483 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 12:39:17.403052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386486 2567 flags.go:64] FLAG: --pod-cidr="" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386490 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386495 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386498 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386501 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386504 2567 flags.go:64] FLAG: --port="10250" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386507 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386510 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd82795096366d9d" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386514 2567 flags.go:64] FLAG: --qos-reserved="" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386517 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386520 2567 flags.go:64] FLAG: --register-node="true" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386523 2567 flags.go:64] FLAG: --register-with-taints="" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386527 2567 flags.go:64] FLAG: --registry-burst="10" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386530 2567 flags.go:64] FLAG: --registry-qps="5" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386533 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386536 2567 flags.go:64] FLAG: --reserved-memory="" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386539 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386542 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386545 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386550 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386553 2567 flags.go:64] FLAG: --runonce="false" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386556 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386559 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386562 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386565 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 12:39:17.403689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386567 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386570 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386573 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386577 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386580 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386583 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386586 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386589 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386592 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386595 2567 flags.go:64] FLAG: --system-cgroups="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386598 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386603 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386607 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386609 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386614 2567 flags.go:64] FLAG: --tls-min-version="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386618 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386621 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386624 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386627 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386630 2567 flags.go:64] FLAG: --v="2" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386634 2567 flags.go:64] FLAG: --version="false" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386638 2567 flags.go:64] FLAG: --vmodule="" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386641 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.386645 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386766 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:39:17.463770 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386770 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:39:17.451310 ip-10-0-143-248 systemd[1]: Started Kubernetes Kubelet. Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386774 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386777 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386780 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386783 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386786 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386789 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386791 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386794 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386796 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386799 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386802 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386804 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386806 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386809 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386812 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386814 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386817 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386820 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:39:17.465306 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386822 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386825 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386827 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386831 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386833 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386836 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386838 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386841 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386843 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386846 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386849 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386852 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386855 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386857 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386863 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386865 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386868 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386870 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386874 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386878 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:39:17.466163 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386880 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386883 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386902 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386906 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386908 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386912 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386915 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386918 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386920 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386923 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386925 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386934 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386936 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386939 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386941 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386945 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386948 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386950 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386953 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386955 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:39:17.466796 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386958 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386960 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386963 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386965 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386968 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386970 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386974 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386977 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386979 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386982 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386985 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386987 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386990 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386992 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386995 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.386999 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387002 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387005 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387007 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:39:17.467448 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387010 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387012 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387015 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387017 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387020 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387023 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387025 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387027 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387031 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387034 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387037 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387040 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387042 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387045 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387047 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387050 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387054 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387057 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387060 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:39:17.468589 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.387065 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.387730 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.396644 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.396665 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.396692 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.396701 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396790 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396798 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396804 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396809 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396813 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396818 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396822 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396826 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396830 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:39:17.469469 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396835 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396840 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396844 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396848 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396852 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396856 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396858 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396861 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396863 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396866 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396869 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396871 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396874 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396877 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396880 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396883 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396902 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396907 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396911 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396919 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:39:17.470380 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396922 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396925 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396928 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396930 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396933 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396936 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396939 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396942 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396945 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396947 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396950 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396952 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396955 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396957 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396960 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396963 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396967 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396971 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396974 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:39:17.471502 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396977 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396981 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396983 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396986 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396989 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396992 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396994 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.396997 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397000 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397003 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397005 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397008 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397010 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397013 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397015 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397018 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397021 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397024 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397027 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397030 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:39:17.472630 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397032 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397035 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397038 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397042 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397045 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397049 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397051 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397054 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397056 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397059 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397061 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397065 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397068 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397070 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397073 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397076 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397078 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397081 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397083 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397086 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:39:17.473808 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397089 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397091 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397094 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397097 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397099 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397102 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397104 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397107 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397109 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397113 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397117 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.397123 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397232 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397237 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397241 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 12:39:17.474947 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397244 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397247 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397249 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397253 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397255 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397258 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397261 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397264 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397267 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397270 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397273 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397276 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397279 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397283 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397286 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397290 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397292 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397295 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397297 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397300 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 12:39:17.475843 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397302 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397305 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397307 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397310 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397313 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397316 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397318 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397321 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397324 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397326 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397329 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397333 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397338 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397343 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397348 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397351 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397354 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397357 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397360 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 12:39:17.476735 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397362 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397365 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397367 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397371 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397373 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397376 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397378 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397381 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397384 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397386 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397389 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397391 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397394 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397397 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397399 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397402 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397405 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397407 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397410 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397412 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 12:39:17.477634 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397415 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397417 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397420 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397423 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397425 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397428 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397430 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397433 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397435 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397438 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397441 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397443 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397446 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397448 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397451 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397453 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397456 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397459 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397462 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397464 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 12:39:17.478527 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397467 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397469 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397473 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397476 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397479 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397482 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397484 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397487 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397490 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397492 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397495 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397498 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397500 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397503 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397506 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397508 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 12:39:17.479210 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:17.397510 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.397515 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.397630 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.401472 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.402777 2567 server.go:1019] "Starting client certificate rotation" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.402876 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.402921 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.405174 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.408396 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.418756 2567 log.go:25] "Validated CRI v1 runtime API" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.422035 2567 log.go:25] "Validated CRI v1 image API" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.423256 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 12:39:17.479673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.426225 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b5ef101b-28fa-421f-81b6-430faa6defe0:/dev/nvme0n1p3 e1191216-7185-4df9-b883-9deeab1262c5:/dev/nvme0n1p4] Jul 16 12:39:17.480134 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.426243 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.431068 2567 manager.go:216] Machine: {Timestamp:2026-07-16 12:39:17.430553114 +0000 UTC m=+0.334059737 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112334 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1428055f8c9b1943fbbe857ee854 SystemUUID:ec2b1428-055f-8c9b-1943-fbbe857ee854 BootID:80942191-199f-4ce2-a26d-d5ca496265ae Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:16:b1:88:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:16:b1:88:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:d1:80:f6:b6:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.431176 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.431285 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.433569 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.433599 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.434385 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.434395 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 12:39:17.480353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.434403 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.434957 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.435767 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.436164 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440613 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440740 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440770 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440782 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440797 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440806 2567 kubelet.go:398] "Adding apiserver pod source" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.440814 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.441176 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.441194 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.443317 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445095 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445122 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445266 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445278 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445283 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445288 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445296 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445301 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445696 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445702 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445709 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445714 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445724 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.445732 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.447178 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.447188 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.450341 2567 server.go:1268] "Started kubelet" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.450425 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.450469 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.450559 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.451199 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.451713 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.451734 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.452461 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.452716 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 16 12:39:17.483075 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.456457 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.459018 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.459258 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q76zq" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.459490 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.459616 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460126 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460142 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460291 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460298 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460504 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460696 2567 factory.go:55] Registering systemd factory Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460712 2567 factory.go:223] Registration of the systemd container factory successfully Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460946 2567 factory.go:153] Registering CRI-O factory Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.460963 2567 factory.go:223] Registration of the crio container factory successfully Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.461026 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.461084 2567 factory.go:103] Registering Raw factory Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.461099 2567 manager.go:1196] Started watching for new ooms in manager Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.461481 2567 manager.go:349] Starting recovery of all containers Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.464650 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-248.ec2.internal.18c2c5805a1a9cbd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-248.ec2.internal,UID:ip-10-0-143-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-248.ec2.internal,},FirstTimestamp:2026-07-16 12:39:17.450316989 +0000 UTC m=+0.353823593,LastTimestamp:2026-07-16 12:39:17.450316989 +0000 UTC m=+0.353823593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-248.ec2.internal,}" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.468381 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q76zq" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.469706 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.469818 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.477252 2567 manager.go:354] Recovery completed Jul 16 12:39:17.484123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.482539 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503350 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503381 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503392 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503881 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503905 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503921 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.503924 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.504659 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.504685 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.504695 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.505145 2567 policy_none.go:49] "None policy: Start" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.505157 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.505167 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:17.506244 2567 policy_none.go:47] "Start" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:17.506643 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-248.ec2.internal.18c2c5805d4413fb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-248.ec2.internal,UID:ip-10-0-143-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-248.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-248.ec2.internal,},FirstTimestamp:2026-07-16 12:39:17.503366139 +0000 UTC m=+0.406872745,LastTimestamp:2026-07-16 12:39:17.503366139 +0000 UTC m=+0.406872745,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-248.ec2.internal,}" Jul 16 12:39:18.810970 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.801658 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.824428 2567 manager.go:337] "Starting Device Plugin manager" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.824636 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.824650 2567 server.go:87] "Starting device plugin registration server" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.824967 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.824982 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.825246 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.825338 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.825347 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.825825 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.825880 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.918486 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-248.ec2.internal\" not found" node="ip-10-0-143-248.ec2.internal" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.925614 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.927104 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.927138 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.927152 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.927196 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-248.ec2.internal" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.934900 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-248.ec2.internal" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.934919 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-248.ec2.internal\": node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.948518 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.968580 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.969838 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.969872 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.969893 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:18.969929 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 12:39:18.978942 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:18.972241 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.049317 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.070480 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"] Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.070555 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.072151 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.072182 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.072192 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.073842 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.073954 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.073985 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.074623 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.074647 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.074656 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.074717 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.074764 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.074796 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.076086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.076115 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.076918 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.076940 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:19.082063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.076949 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:19.195943 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.104518 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b5c4ad47968662d249911b30e17464c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-248.ec2.internal\" (UID: \"2b5c4ad47968662d249911b30e17464c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.195943 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.104544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0e52785e157fda23e5aebcedf772e66-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"e0e52785e157fda23e5aebcedf772e66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.195943 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.104561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e52785e157fda23e5aebcedf772e66-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"e0e52785e157fda23e5aebcedf772e66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.195943 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.108420 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-248.ec2.internal\" not found" node="ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.195943 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.111948 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-248.ec2.internal\" not found" node="ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.195943 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.150061 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.205613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b5c4ad47968662d249911b30e17464c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-248.ec2.internal\" (UID: \"2b5c4ad47968662d249911b30e17464c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.205642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0e52785e157fda23e5aebcedf772e66-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"e0e52785e157fda23e5aebcedf772e66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.205657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e52785e157fda23e5aebcedf772e66-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"e0e52785e157fda23e5aebcedf772e66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.205686 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e52785e157fda23e5aebcedf772e66-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"e0e52785e157fda23e5aebcedf772e66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.205707 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b5c4ad47968662d249911b30e17464c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-248.ec2.internal\" (UID: \"2b5c4ad47968662d249911b30e17464c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.205714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0e52785e157fda23e5aebcedf772e66-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"e0e52785e157fda23e5aebcedf772e66\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.328686 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.250755 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.460205 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.351283 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.460205 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.410747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.460205 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.415132 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" Jul 16 12:39:19.460205 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.452391 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.577594 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.553325 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.809348 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.799572 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:19.809348 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.799617 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 12:39:19.809348 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.799622 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 12:34:18 +0000 UTC" deadline="2028-04-07 22:58:22.416810334 +0000 UTC" Jul 16 12:39:19.809348 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.799653 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15154h19m2.617160691s" Jul 16 12:39:19.809348 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.799791 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 12:39:19.918865 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.813124 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:39:19.918865 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.814786 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 12:39:19.918865 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.815686 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory" Jul 16 12:39:19.918865 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.815714 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 12:39:19.918865 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:19.815726 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID" Jul 16 12:39:19.918865 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:19.900309 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:20.001250 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:20.001222 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:20.101697 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:20.101663 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:20.109714 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:20.109683 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e52785e157fda23e5aebcedf772e66.slice/crio-57320bf2e0805514dd6651947eee2486f0e7552f512185c3e30dfa059ba4b13e WatchSource:0}: Error finding container 57320bf2e0805514dd6651947eee2486f0e7552f512185c3e30dfa059ba4b13e: Status 404 returned error can't find the container with id 57320bf2e0805514dd6651947eee2486f0e7552f512185c3e30dfa059ba4b13e Jul 16 12:39:20.109968 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:20.109950 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5c4ad47968662d249911b30e17464c.slice/crio-7dcf0b96fef57de360ad346ec4e3128474d4d24b5745ed06eec9a006dce51f05 WatchSource:0}: Error finding container 7dcf0b96fef57de360ad346ec4e3128474d4d24b5745ed06eec9a006dce51f05: Status 404 returned error can't find the container with id 7dcf0b96fef57de360ad346ec4e3128474d4d24b5745ed06eec9a006dce51f05 Jul 16 12:39:20.113210 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.113196 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:39:20.202545 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:20.202461 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found" Jul 16 12:39:20.237895 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.237868 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:39:20.268128 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.268106 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:39:20.301871 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.301835 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" Jul 16 12:39:20.312538 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.312514 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 12:39:20.313493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.313478 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" Jul 16 12:39:20.320608 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.320595 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 12:39:20.800623 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.800589 2567 apiserver.go:52] "Watching apiserver" Jul 16 12:39:20.801471 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.801445 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 12:39:20.810263 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.810107 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 12:39:20.810943 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.810494 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-x2zfh","openshift-multus/multus-bftcm","openshift-network-diagnostics/network-check-target-svkwm","openshift-ovn-kubernetes/ovnkube-node-wtxb9","kube-system/global-pull-secret-syncer-n2596","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc","openshift-cluster-node-tuning-operator/tuned-nvvhx","openshift-dns/node-resolver-h4lld","openshift-image-registry/node-ca-98p2d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal","openshift-multus/network-metrics-daemon-w7h87","openshift-network-operator/iptables-alerter-5xzw7","kube-system/konnectivity-agent-9tbsr","kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"] Jul 16 12:39:20.812208 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.812098 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.812782 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.812726 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 12:39:20.814655 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.814631 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:20.814811 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:20.814712 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:20.815363 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.815345 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2w4h5\"" Jul 16 12:39:20.815619 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.815583 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.815772 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.815749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:20.815847 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.815784 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.815847 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:20.815810 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:20.817396 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.817374 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.818808 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.818790 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.819506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.819483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 12:39:20.819600 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.819577 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 12:39:20.820163 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.819994 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gwvkk\"" Jul 16 12:39:20.820403 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.820188 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 12:39:20.820403 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.820378 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.820575 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.820457 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.820575 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.820549 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 12:39:20.820685 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.820646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:20.820880 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.820857 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 12:39:20.821396 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.821343 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.821396 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.821379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 12:39:20.821635 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.821413 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-stqqp\"" Jul 16 12:39:20.821635 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.821346 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.822451 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.822382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:20.823176 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.823157 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 12:39:20.823372 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.823357 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 12:39:20.823940 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.823670 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-55nf8\"" Jul 16 12:39:20.825775 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.824510 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.825775 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.824584 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bthhj\"" Jul 16 12:39:20.825775 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.824727 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 12:39:20.825775 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.825060 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.825775 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.825217 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.826521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.826421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:20.826521 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:20.826487 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:20.827238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.827220 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 12:39:20.828092 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.827454 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.828092 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.827576 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hmblm\"" Jul 16 12:39:20.828092 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.827680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.828382 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.828346 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.830516 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.830429 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 12:39:20.830516 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.830494 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 12:39:20.834780 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.831331 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hdmlt\"" Jul 16 12:39:20.834780 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.831441 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:20.834780 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.833678 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rzhqh\"" Jul 16 12:39:20.834780 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.834190 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 12:39:20.834780 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.834610 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.835145 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.834798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.835145 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.835045 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fd2rp" Jul 16 12:39:20.837020 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.837002 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:20.839794 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.839776 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p8kkx\"" Jul 16 12:39:20.839889 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.839844 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 12:39:20.839958 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.839784 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 12:39:20.843459 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.843274 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fd2rp" Jul 16 12:39:20.904315 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904289 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 12:39:20.904432 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-systemd-units\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904432 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904550 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904450 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904550 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.904550 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f29178a-d849-4a92-a61f-6e894e5786e0-tmp-dir\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:20.904690 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-kubelet\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904690 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hkbg\" (UniqueName: \"kubernetes.io/projected/b26a799c-13a5-42ee-8f2a-9074999b181b-kube-api-access-8hkbg\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904690 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-socket-dir-parent\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.904690 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-kubernetes\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ecced20-759e-4625-a40e-8e953c9da289-host\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3feeaad-f2f6-414d-a56f-63620ccd4911-iptables-alerter-script\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-systemd\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-cni-bin\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-netns\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-daemon-config\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-multus-certs\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.904891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjfk\" (UniqueName: \"kubernetes.io/projected/f42e6cf8-773b-44bb-a870-01769976d1a4-kube-api-access-vmjfk\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-os-release\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.904986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-cni-binary-copy\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-socket-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysctl-d\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-log-socket\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.905229 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-ovnkube-config\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.905478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-ovnkube-script-lib\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.905478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-cni-multus\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.905478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-kubelet\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.905478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/971d554c-272a-4b67-8d77-219e233949cf-konnectivity-ca\") pod \"konnectivity-agent-9tbsr\" (UID: \"971d554c-272a-4b67-8d77-219e233949cf\") " pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:20.905478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-host\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.905478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-etc-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.905647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-cni-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.905647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/971d554c-272a-4b67-8d77-219e233949cf-agent-certs\") pod \"konnectivity-agent-9tbsr\" (UID: \"971d554c-272a-4b67-8d77-219e233949cf\") " pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:20.905647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-sys-fs\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.905647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3feeaad-f2f6-414d-a56f-63620ccd4911-host-slash\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:20.905647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shm68\" (UniqueName: \"kubernetes.io/projected/2f29178a-d849-4a92-a61f-6e894e5786e0-kube-api-access-shm68\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:20.905647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.905843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-cnibin\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.905843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-conf-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.905843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-sys\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.905843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-system-cni-dir\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.905843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-tuned\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.905995 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wjp\" (UniqueName: \"kubernetes.io/projected/6ecced20-759e-4625-a40e-8e953c9da289-kube-api-access-p6wjp\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:20.905995 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-registration-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.905995 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cnibin\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.905995 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.905937 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jx9\" (UniqueName: \"kubernetes.io/projected/c3feeaad-f2f6-414d-a56f-63620ccd4911-kube-api-access-89jx9\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:20.906102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906010 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:20.906102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-node-log\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.906102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-k8s-cni-cncf-io\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.906181 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:20.906181 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42e6cf8-773b-44bb-a870-01769976d1a4-tmp\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.906303 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906195 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.906399 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.906457 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-os-release\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.906457 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-var-lib-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.906554 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9334156f-b91f-4e46-be62-df2ebb2b746e-kubelet-config\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:20.906554 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-systemd\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.906554 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f29178a-d849-4a92-a61f-6e894e5786e0-hosts-file\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:20.906554 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysctl-conf\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-cni-bin\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-run\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-lib-modules\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p7hc\" (UniqueName: \"kubernetes.io/projected/ae5a4427-93c7-45dc-879a-9bbe2100fa19-kube-api-access-9p7hc\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-modprobe-d\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-cni-netd\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-device-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:20.906806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcbv\" (UniqueName: \"kubernetes.io/projected/174ca112-4d79-4fba-92d3-af4b905da5f7-kube-api-access-5kcbv\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-var-lib-kubelet\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-slash\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-env-overrides\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-etc-kubernetes\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.906971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxpm\" (UniqueName: \"kubernetes.io/projected/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-kube-api-access-nwxpm\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907009 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9334156f-b91f-4e46-be62-df2ebb2b746e-dbus\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5tz4\" (UniqueName: \"kubernetes.io/projected/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-kube-api-access-m5tz4\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-run-netns\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b26a799c-13a5-42ee-8f2a-9074999b181b-ovn-node-metrics-cert\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ecced20-759e-4625-a40e-8e953c9da289-serviceca\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-ovn\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907160 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-system-cni-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-hostroot\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:20.907238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.907221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysconfig\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:20.979411 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.979344 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" event={"ID":"e0e52785e157fda23e5aebcedf772e66","Type":"ContainerStarted","Data":"57320bf2e0805514dd6651947eee2486f0e7552f512185c3e30dfa059ba4b13e"} Jul 16 12:39:20.982016 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:20.981985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" event={"ID":"2b5c4ad47968662d249911b30e17464c","Type":"ContainerStarted","Data":"7dcf0b96fef57de360ad346ec4e3128474d4d24b5745ed06eec9a006dce51f05"} Jul 16 12:39:21.007483 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007453 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-systemd\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.007483 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-cni-bin\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-netns\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-daemon-config\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-multus-certs\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-systemd\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007588 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-cni-bin\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007602 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-multus-certs\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007586 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-netns\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.007680 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjfk\" (UniqueName: \"kubernetes.io/projected/f42e6cf8-773b-44bb-a870-01769976d1a4-kube-api-access-vmjfk\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-os-release\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-cni-binary-copy\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-socket-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007833 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-os-release\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysctl-d\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-log-socket\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.008042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.007956 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.008484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-ovnkube-config\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.008484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-daemon-config\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.008484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008198 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-log-socket\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.008484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008282 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysctl-d\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.008484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008328 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-socket-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.008484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-ovnkube-script-lib\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.008824 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.008796 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-cni-binary-copy\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.009318 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009177 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-ovnkube-config\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.009318 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.009318 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-cni-multus\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009535 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-ovnkube-script-lib\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-kubelet\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/971d554c-272a-4b67-8d77-219e233949cf-konnectivity-ca\") pod \"konnectivity-agent-9tbsr\" (UID: \"971d554c-272a-4b67-8d77-219e233949cf\") " pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009618 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-kubelet\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009367 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-cni-multus\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-host\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-etc-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-cni-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/971d554c-272a-4b67-8d77-219e233949cf-agent-certs\") pod \"konnectivity-agent-9tbsr\" (UID: \"971d554c-272a-4b67-8d77-219e233949cf\") " pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.009963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-sys-fs\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3feeaad-f2f6-414d-a56f-63620ccd4911-host-slash\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shm68\" (UniqueName: \"kubernetes.io/projected/2f29178a-d849-4a92-a61f-6e894e5786e0-kube-api-access-shm68\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-cnibin\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-conf-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-sys\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-system-cni-dir\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-tuned\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010248 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/971d554c-272a-4b67-8d77-219e233949cf-konnectivity-ca\") pod \"konnectivity-agent-9tbsr\" (UID: \"971d554c-272a-4b67-8d77-219e233949cf\") " pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wjp\" (UniqueName: \"kubernetes.io/projected/6ecced20-759e-4625-a40e-8e953c9da289-kube-api-access-p6wjp\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-registration-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010339 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3feeaad-f2f6-414d-a56f-63620ccd4911-host-slash\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cnibin\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010398 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-host\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-etc-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jx9\" (UniqueName: \"kubernetes.io/projected/c3feeaad-f2f6-414d-a56f-63620ccd4911-kube-api-access-89jx9\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-node-log\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.012933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-k8s-cni-cncf-io\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42e6cf8-773b-44bb-a870-01769976d1a4-tmp\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010717 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-cni-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-os-release\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-var-lib-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9334156f-b91f-4e46-be62-df2ebb2b746e-kubelet-config\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.010951 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-systemd\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f29178a-d849-4a92-a61f-6e894e5786e0-hosts-file\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysctl-conf\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-cni-bin\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-run\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011260 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 12:39:21.013592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-lib-modules\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p7hc\" (UniqueName: \"kubernetes.io/projected/ae5a4427-93c7-45dc-879a-9bbe2100fa19-kube-api-access-9p7hc\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-modprobe-d\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-cni-netd\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-device-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcbv\" (UniqueName: \"kubernetes.io/projected/174ca112-4d79-4fba-92d3-af4b905da5f7-kube-api-access-5kcbv\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-var-lib-kubelet\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-slash\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-env-overrides\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-etc-kubernetes\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxpm\" (UniqueName: \"kubernetes.io/projected/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-kube-api-access-nwxpm\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011846 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-sys-fs\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9334156f-b91f-4e46-be62-df2ebb2b746e-dbus\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:21.014264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5tz4\" (UniqueName: \"kubernetes.io/projected/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-kube-api-access-m5tz4\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-run-netns\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b26a799c-13a5-42ee-8f2a-9074999b181b-ovn-node-metrics-cert\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012011 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ecced20-759e-4625-a40e-8e953c9da289-serviceca\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-ovn\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.011930 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9334156f-b91f-4e46-be62-df2ebb2b746e-dbus\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012678 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-modprobe-d\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cnibin\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012809 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-os-release\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012899 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-cnibin\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.012996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-node-log\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013055 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysctl-conf\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013083 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-run-k8s-cni-cncf-io\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013156 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-host-var-lib-cni-bin\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013390 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b26a799c-13a5-42ee-8f2a-9074999b181b-env-overrides\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.014888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-system-cni-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013535 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9334156f-b91f-4e46-be62-df2ebb2b746e-kubelet-config\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013553 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-conf-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013570 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-var-lib-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013624 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-registration-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.013650 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013666 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-systemd\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013623 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013725 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-device-dir\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013844 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-var-lib-kubelet\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013874 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-lib-modules\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013921 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ecced20-759e-4625-a40e-8e953c9da289-serviceca\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013932 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-run\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-cni-netd\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.013987 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:21.015518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013999 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f29178a-d849-4a92-a61f-6e894e5786e0-hosts-file\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014019 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-run-netns\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.014056 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:39:21.513984225 +0000 UTC m=+3.175644309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014058 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-system-cni-dir\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014089 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae5a4427-93c7-45dc-879a-9bbe2100fa19-system-cni-dir\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014164 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-sys\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.013805 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-ovn\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014277 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-slash\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.014338 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:39:21.514304546 +0000 UTC m=+3.175964623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-hostroot\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysconfig\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014522 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-hostroot\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014565 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-sysconfig\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.016200 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014779 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-etc-kubernetes\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-systemd-units\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.014975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f29178a-d849-4a92-a61f-6e894e5786e0-tmp-dir\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-kubelet\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015049 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-kubelet\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hkbg\" (UniqueName: \"kubernetes.io/projected/b26a799c-13a5-42ee-8f2a-9074999b181b-kube-api-access-8hkbg\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-systemd-units\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-socket-dir-parent\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-run-openvswitch\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-kubernetes\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015138 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cni-binary-copy\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.016826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015220 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b26a799c-13a5-42ee-8f2a-9074999b181b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015242 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-kubernetes\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.015185 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.015299 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.015316 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015333 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-multus-socket-dir-parent\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ecced20-759e-4625-a40e-8e953c9da289-host\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015443 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ecced20-759e-4625-a40e-8e953c9da289-host\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015518 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f29178a-d849-4a92-a61f-6e894e5786e0-tmp-dir\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.015571 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:39:21.515364742 +0000 UTC m=+3.177024821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015629 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.017490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.015628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3feeaad-f2f6-414d-a56f-63620ccd4911-iptables-alerter-script\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.018066 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.017799 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae5a4427-93c7-45dc-879a-9bbe2100fa19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.018066 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.017993 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f42e6cf8-773b-44bb-a870-01769976d1a4-etc-tuned\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.018160 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.018086 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b26a799c-13a5-42ee-8f2a-9074999b181b-ovn-node-metrics-cert\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.018160 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.018110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/971d554c-272a-4b67-8d77-219e233949cf-agent-certs\") pod \"konnectivity-agent-9tbsr\" (UID: \"971d554c-272a-4b67-8d77-219e233949cf\") " pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:21.018253 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.018164 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3feeaad-f2f6-414d-a56f-63620ccd4911-iptables-alerter-script\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.019226 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.019198 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjfk\" (UniqueName: \"kubernetes.io/projected/f42e6cf8-773b-44bb-a870-01769976d1a4-kube-api-access-vmjfk\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.020184 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.020160 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42e6cf8-773b-44bb-a870-01769976d1a4-tmp\") pod \"tuned-nvvhx\" (UID: \"f42e6cf8-773b-44bb-a870-01769976d1a4\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.020783 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.020759 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shm68\" (UniqueName: \"kubernetes.io/projected/2f29178a-d849-4a92-a61f-6e894e5786e0-kube-api-access-shm68\") pod \"node-resolver-h4lld\" (UID: \"2f29178a-d849-4a92-a61f-6e894e5786e0\") " pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.023062 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.022388 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxpm\" (UniqueName: \"kubernetes.io/projected/85d3ae17-677b-4cc3-82d9-f08a2b3ec188-kube-api-access-nwxpm\") pod \"multus-bftcm\" (UID: \"85d3ae17-677b-4cc3-82d9-f08a2b3ec188\") " pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.024400 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.024372 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5tz4\" (UniqueName: \"kubernetes.io/projected/05e6e89a-9cbb-4d48-81c3-2d22c6cb312d-kube-api-access-m5tz4\") pod \"aws-ebs-csi-driver-node-pq2fc\" (UID: \"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.025047 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.025006 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jx9\" (UniqueName: \"kubernetes.io/projected/c3feeaad-f2f6-414d-a56f-63620ccd4911-kube-api-access-89jx9\") pod \"iptables-alerter-5xzw7\" (UID: \"c3feeaad-f2f6-414d-a56f-63620ccd4911\") " pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.025455 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.025422 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p7hc\" (UniqueName: \"kubernetes.io/projected/ae5a4427-93c7-45dc-879a-9bbe2100fa19-kube-api-access-9p7hc\") pod \"multus-additional-cni-plugins-x2zfh\" (UID: \"ae5a4427-93c7-45dc-879a-9bbe2100fa19\") " pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.025625 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.025606 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcbv\" (UniqueName: \"kubernetes.io/projected/174ca112-4d79-4fba-92d3-af4b905da5f7-kube-api-access-5kcbv\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:21.026037 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.026016 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hkbg\" (UniqueName: \"kubernetes.io/projected/b26a799c-13a5-42ee-8f2a-9074999b181b-kube-api-access-8hkbg\") pod \"ovnkube-node-wtxb9\" (UID: \"b26a799c-13a5-42ee-8f2a-9074999b181b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.026134 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.026077 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wjp\" (UniqueName: \"kubernetes.io/projected/6ecced20-759e-4625-a40e-8e953c9da289-kube-api-access-p6wjp\") pod \"node-ca-98p2d\" (UID: \"6ecced20-759e-4625-a40e-8e953c9da289\") " pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.079042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.078959 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 12:39:21.129271 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.129237 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" Jul 16 12:39:21.138921 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.138899 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:21.147935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.147913 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bftcm" Jul 16 12:39:21.153758 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.153729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:21.162522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.162500 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98p2d" Jul 16 12:39:21.172342 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.172322 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" Jul 16 12:39:21.180048 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.180032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" Jul 16 12:39:21.188889 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.188864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5xzw7" Jul 16 12:39:21.196797 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.196778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4lld" Jul 16 12:39:21.518430 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.518343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:21.518430 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.518387 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.518440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518533 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518556 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518579 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518593 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518603 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518617 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:39:22.51859646 +0000 UTC m=+4.180256535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518640 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:39:22.518626187 +0000 UTC m=+4.180286261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:21.518655 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:21.518660 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:39:22.518650421 +0000 UTC m=+4.180310483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:21.846902 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.846809 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:34:20 +0000 UTC" deadline="2027-12-26 04:24:10.020466247 +0000 UTC" Jul 16 12:39:21.846902 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:21.846845 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12663h44m48.173625588s" Jul 16 12:39:22.055477 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.055446 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971d554c_272a_4b67_8d77_219e233949cf.slice/crio-170282e87015dd292a76a9676d71945fc78f642da697d631679af4d2d470fe58 WatchSource:0}: Error finding container 170282e87015dd292a76a9676d71945fc78f642da697d631679af4d2d470fe58: Status 404 returned error can't find the container with id 170282e87015dd292a76a9676d71945fc78f642da697d631679af4d2d470fe58 Jul 16 12:39:22.058411 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.058390 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f29178a_d849_4a92_a61f_6e894e5786e0.slice/crio-63722baea403c04e123984027b75d5bf6152103442416973d5fdbdf7918ace01 WatchSource:0}: Error finding container 63722baea403c04e123984027b75d5bf6152103442416973d5fdbdf7918ace01: Status 404 returned error can't find the container with id 63722baea403c04e123984027b75d5bf6152103442416973d5fdbdf7918ace01 Jul 16 12:39:22.061112 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.061086 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3feeaad_f2f6_414d_a56f_63620ccd4911.slice/crio-3794f0bd1a4bb2dac7b6edcfec9a0ed811e347a1ae044b6f98ae5268feb0291c WatchSource:0}: Error finding container 3794f0bd1a4bb2dac7b6edcfec9a0ed811e347a1ae044b6f98ae5268feb0291c: Status 404 returned error can't find the container with id 3794f0bd1a4bb2dac7b6edcfec9a0ed811e347a1ae044b6f98ae5268feb0291c Jul 16 12:39:22.061979 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.061943 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26a799c_13a5_42ee_8f2a_9074999b181b.slice/crio-9127ec7d2b1e6917e95f3354605817ae65090810229198bfa25d236d120dd29c WatchSource:0}: Error finding container 9127ec7d2b1e6917e95f3354605817ae65090810229198bfa25d236d120dd29c: Status 404 returned error can't find the container with id 9127ec7d2b1e6917e95f3354605817ae65090810229198bfa25d236d120dd29c Jul 16 12:39:22.062840 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.062791 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42e6cf8_773b_44bb_a870_01769976d1a4.slice/crio-1005ac94fe721bfe7ed59d46db8811c5978131455f168a59c9d9ce4665930d04 WatchSource:0}: Error finding container 1005ac94fe721bfe7ed59d46db8811c5978131455f168a59c9d9ce4665930d04: Status 404 returned error can't find the container with id 1005ac94fe721bfe7ed59d46db8811c5978131455f168a59c9d9ce4665930d04 Jul 16 12:39:22.065923 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.065667 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecced20_759e_4625_a40e_8e953c9da289.slice/crio-0fcee0620e24c6041ff0818321eed18f15a08c02b13e9bfe6fe9846ca2488dc8 WatchSource:0}: Error finding container 0fcee0620e24c6041ff0818321eed18f15a08c02b13e9bfe6fe9846ca2488dc8: Status 404 returned error can't find the container with id 0fcee0620e24c6041ff0818321eed18f15a08c02b13e9bfe6fe9846ca2488dc8 Jul 16 12:39:22.066036 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.066020 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5a4427_93c7_45dc_879a_9bbe2100fa19.slice/crio-57a96396cbe520210dbed8e00c5023fb61b7847a28e8619fb8d59dcde339867e WatchSource:0}: Error finding container 57a96396cbe520210dbed8e00c5023fb61b7847a28e8619fb8d59dcde339867e: Status 404 returned error can't find the container with id 57a96396cbe520210dbed8e00c5023fb61b7847a28e8619fb8d59dcde339867e Jul 16 12:39:22.067125 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.066615 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d3ae17_677b_4cc3_82d9_f08a2b3ec188.slice/crio-8ba10d30a134410baf1a5867b1c80c7a5f79a541afefa67643364c7303e159db WatchSource:0}: Error finding container 8ba10d30a134410baf1a5867b1c80c7a5f79a541afefa67643364c7303e159db: Status 404 returned error can't find the container with id 8ba10d30a134410baf1a5867b1c80c7a5f79a541afefa67643364c7303e159db Jul 16 12:39:22.067921 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:39:22.067898 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e6e89a_9cbb_4d48_81c3_2d22c6cb312d.slice/crio-c61cceee1850f5f221ae24f57b7137009fe952fb66015f1420f752109fec6fd9 WatchSource:0}: Error finding container c61cceee1850f5f221ae24f57b7137009fe952fb66015f1420f752109fec6fd9: Status 404 returned error can't find the container with id c61cceee1850f5f221ae24f57b7137009fe952fb66015f1420f752109fec6fd9 Jul 16 12:39:22.526934 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.526644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:22.526934 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.526869 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:22.526934 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.526901 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:22.526934 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.526916 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:22.526934 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.526931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:22.527278 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.526963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:22.527278 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.526982 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:39:24.526961407 +0000 UTC m=+6.188621483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:22.527278 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.527048 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:22.527278 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.527051 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:22.527278 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.527102 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:39:24.527089016 +0000 UTC m=+6.188749078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:22.527278 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.527121 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:39:24.527110719 +0000 UTC m=+6.188770782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:22.847722 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.847604 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 12:34:20 +0000 UTC" deadline="2028-03-23 01:30:37.045510776 +0000 UTC" Jul 16 12:39:22.847722 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.847670 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14772h51m14.197845385s" Jul 16 12:39:22.973150 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.973118 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:22.973320 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.973121 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:22.973320 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.973246 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:22.973449 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.973343 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:22.973449 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:22.973132 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:22.973551 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:22.973466 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:23.001242 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.000472 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" event={"ID":"2b5c4ad47968662d249911b30e17464c","Type":"ContainerStarted","Data":"09288d12b4a95a2f9a0b93de01e65a6802e630d970cc47796c296648cd6ed7b2"} Jul 16 12:39:23.011677 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.011008 2567 generic.go:356] "Generic (PLEG): container finished" podID="e0e52785e157fda23e5aebcedf772e66" containerID="3bd279549355b64f49743247cb1d643ce85f07657cb0dfc5be0c14ba848258e0" exitCode=0 Jul 16 12:39:23.011677 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.011154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" event={"ID":"e0e52785e157fda23e5aebcedf772e66","Type":"ContainerDied","Data":"3bd279549355b64f49743247cb1d643ce85f07657cb0dfc5be0c14ba848258e0"} Jul 16 12:39:23.015126 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.015050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98p2d" event={"ID":"6ecced20-759e-4625-a40e-8e953c9da289","Type":"ContainerStarted","Data":"0fcee0620e24c6041ff0818321eed18f15a08c02b13e9bfe6fe9846ca2488dc8"} Jul 16 12:39:23.026315 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.026285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" event={"ID":"f42e6cf8-773b-44bb-a870-01769976d1a4","Type":"ContainerStarted","Data":"1005ac94fe721bfe7ed59d46db8811c5978131455f168a59c9d9ce4665930d04"} Jul 16 12:39:23.030213 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.030162 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" podStartSLOduration=3.030142905 podStartE2EDuration="3.030142905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:23.014692668 +0000 UTC m=+4.676352753" watchObservedRunningTime="2026-07-16 12:39:23.030142905 +0000 UTC m=+4.691802990" Jul 16 12:39:23.045896 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.045861 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"9127ec7d2b1e6917e95f3354605817ae65090810229198bfa25d236d120dd29c"} Jul 16 12:39:23.059206 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.059121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tbsr" event={"ID":"971d554c-272a-4b67-8d77-219e233949cf","Type":"ContainerStarted","Data":"170282e87015dd292a76a9676d71945fc78f642da697d631679af4d2d470fe58"} Jul 16 12:39:23.063986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.063955 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" event={"ID":"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d","Type":"ContainerStarted","Data":"c61cceee1850f5f221ae24f57b7137009fe952fb66015f1420f752109fec6fd9"} Jul 16 12:39:23.077799 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.077765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bftcm" event={"ID":"85d3ae17-677b-4cc3-82d9-f08a2b3ec188","Type":"ContainerStarted","Data":"8ba10d30a134410baf1a5867b1c80c7a5f79a541afefa67643364c7303e159db"} Jul 16 12:39:23.080397 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.080362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerStarted","Data":"57a96396cbe520210dbed8e00c5023fb61b7847a28e8619fb8d59dcde339867e"} Jul 16 12:39:23.082002 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.081977 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5xzw7" event={"ID":"c3feeaad-f2f6-414d-a56f-63620ccd4911","Type":"ContainerStarted","Data":"3794f0bd1a4bb2dac7b6edcfec9a0ed811e347a1ae044b6f98ae5268feb0291c"} Jul 16 12:39:23.084209 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:23.084185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4lld" event={"ID":"2f29178a-d849-4a92-a61f-6e894e5786e0","Type":"ContainerStarted","Data":"63722baea403c04e123984027b75d5bf6152103442416973d5fdbdf7918ace01"} Jul 16 12:39:24.104324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.104251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" event={"ID":"e0e52785e157fda23e5aebcedf772e66","Type":"ContainerStarted","Data":"b1e9b0b9cb154b818d6bd9e91ccc164ab78cbaebd692e56945296aae9c224d7d"} Jul 16 12:39:24.544698 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.544621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:24.544698 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.544683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:24.544930 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.544712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:24.544930 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.544867 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:24.544930 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.544928 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:39:28.544908901 +0000 UTC m=+10.206568964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:24.545544 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.545326 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:24.545544 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.545351 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:24.545544 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.545365 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:24.545544 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.545408 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:39:28.545393324 +0000 UTC m=+10.207053389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:24.545544 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.545473 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:24.545544 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.545505 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:39:28.545494027 +0000 UTC m=+10.207154091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:24.971539 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.971326 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:24.971539 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.971345 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:24.971539 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.971478 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:24.971910 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:24.971816 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:24.971972 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.971908 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:24.972034 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:24.971990 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:26.971030 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:26.970863 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:26.971030 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:26.970868 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:26.971030 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:26.971011 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:26.971561 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:26.971118 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:26.971561 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:26.971155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:26.971561 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:26.971231 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:28.581532 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:28.581494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:28.581542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:28.581569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581676 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581696 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581700 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581731 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581761 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581772 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:39:36.581748651 +0000 UTC m=+18.243408726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581793 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:39:36.581783205 +0000 UTC m=+18.243443271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:28.582048 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.581807 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:39:36.581799258 +0000 UTC m=+18.243459324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:28.971902 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:28.971749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:28.971902 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:28.971859 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:28.971902 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.971868 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:28.972173 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.971970 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:28.972173 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:28.972023 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:28.972173 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:28.972071 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:30.970629 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:30.970577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:30.970629 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:30.970598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:30.971213 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:30.970577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:30.971213 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:30.970757 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:30.971213 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:30.970845 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:30.971213 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:30.970931 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:32.970385 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:32.970343 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:32.970853 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:32.970411 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:32.970853 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:32.970426 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:32.970853 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:32.970523 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:32.970853 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:32.970615 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:32.970853 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:32.970700 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:34.970479 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:34.970424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:34.970479 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:34.970461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:34.971054 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:34.970424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:34.971054 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:34.970551 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:34.971054 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:34.970763 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:34.971054 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:34.970890 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:36.646502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:36.646554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:36.646622 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646634 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646702 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:39:52.646682504 +0000 UTC m=+34.308342588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646800 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646821 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:36.646878 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646834 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:36.647666 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646913 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:39:52.64690069 +0000 UTC m=+34.308560769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:36.647666 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.646978 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:36.647666 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.647013 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:39:52.647002116 +0000 UTC m=+34.308662184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:36.970898 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:36.970681 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:36.971078 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:36.970689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:36.971078 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:36.970765 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:36.971078 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.971005 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:36.971239 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.971135 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:36.971289 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:36.971227 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:37.129391 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.129352 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98p2d" event={"ID":"6ecced20-759e-4625-a40e-8e953c9da289","Type":"ContainerStarted","Data":"7e1e38de2137f830d201e4b75e1d3c98c9e600de8708048e5ad25e69b6d630de"} Jul 16 12:39:37.130839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.130807 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" event={"ID":"f42e6cf8-773b-44bb-a870-01769976d1a4","Type":"ContainerStarted","Data":"46031325cc582c09a5926e814fb7e7f1b5f98d65dbf2054c8f800a6fd4895bbe"} Jul 16 12:39:37.132193 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.132162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tbsr" event={"ID":"971d554c-272a-4b67-8d77-219e233949cf","Type":"ContainerStarted","Data":"eb762626691716e939fe51cda945c4cfbf9a4d476a4ab475458a12416c7b0e22"} Jul 16 12:39:37.133587 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.133565 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" event={"ID":"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d","Type":"ContainerStarted","Data":"aae78d79a01c9be7db03d9e3a13a165b16e096bff0afe40c127204310ba5436b"} Jul 16 12:39:37.135080 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.135038 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bftcm" event={"ID":"85d3ae17-677b-4cc3-82d9-f08a2b3ec188","Type":"ContainerStarted","Data":"14528be4f37fdb390f44171f11f0cbae6ecef39dc28154ade312277ccd173de6"} Jul 16 12:39:37.136851 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.136809 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4427-93c7-45dc-879a-9bbe2100fa19" containerID="007dd4f3e4378979ae9647540393ef2110de1e91d52118e7f3260688c0efd60f" exitCode=0 Jul 16 12:39:37.137026 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.136877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerDied","Data":"007dd4f3e4378979ae9647540393ef2110de1e91d52118e7f3260688c0efd60f"} Jul 16 12:39:37.138585 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.138564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4lld" event={"ID":"2f29178a-d849-4a92-a61f-6e894e5786e0","Type":"ContainerStarted","Data":"656e53561b401cafa8b7d3913ecac2154a4ee66311de2862a8ef48fd128e995f"} Jul 16 12:39:37.144302 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.144260 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-98p2d" podStartSLOduration=4.91346547 podStartE2EDuration="19.144248485s" totalImagesPullingTime="14.230783015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:37.14397461 +0000 UTC m=+18.805634693" watchObservedRunningTime="2026-07-16 12:39:37.144248485 +0000 UTC m=+18.805908568" Jul 16 12:39:37.144402 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.144331 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" podStartSLOduration=17.144326566 podStartE2EDuration="17.144326566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:24.12231487 +0000 UTC m=+5.783974954" watchObservedRunningTime="2026-07-16 12:39:37.144326566 +0000 UTC m=+18.805986648" Jul 16 12:39:37.162471 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.162423 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bftcm" podStartSLOduration=4.576457823 podStartE2EDuration="19.162408706s" totalImagesPullingTime="14.585950883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:37.161877301 +0000 UTC m=+18.823537384" watchObservedRunningTime="2026-07-16 12:39:37.162408706 +0000 UTC m=+18.824068789" Jul 16 12:39:37.220467 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.220411 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9tbsr" podStartSLOduration=5.016638348 podStartE2EDuration="19.220396405s" totalImagesPullingTime="14.203758057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:37.220308819 +0000 UTC m=+18.881968901" watchObservedRunningTime="2026-07-16 12:39:37.220396405 +0000 UTC m=+18.882056585" Jul 16 12:39:37.220883 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.220859 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nvvhx" podStartSLOduration=4.675543415 podStartE2EDuration="19.220852151s" totalImagesPullingTime="14.545308736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:37.202940333 +0000 UTC m=+18.864600416" watchObservedRunningTime="2026-07-16 12:39:37.220852151 +0000 UTC m=+18.882512237" Jul 16 12:39:37.234031 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:37.233944 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h4lld" podStartSLOduration=3.996031842 podStartE2EDuration="18.233925415s" totalImagesPullingTime="14.237893573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:37.233899038 +0000 UTC m=+18.895559137" watchObservedRunningTime="2026-07-16 12:39:37.233925415 +0000 UTC m=+18.895585493" Jul 16 12:39:38.141763 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.141699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5xzw7" event={"ID":"c3feeaad-f2f6-414d-a56f-63620ccd4911","Type":"ContainerStarted","Data":"447e4be94466db4909870bb17a1875b1209631df846ad8f9324a87eb0111c953"} Jul 16 12:39:38.497988 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.497957 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 12:39:38.834922 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.834782 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T12:39:38.497977084Z","UUID":"1a230560-1474-4fda-a5b5-cc676aab1e62","Handler":null,"Name":"","Endpoint":""} Jul 16 12:39:38.836398 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.836375 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 12:39:38.836509 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.836416 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 12:39:38.870857 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.870825 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:38.971676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.971633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:38.971861 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.971768 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:38.971861 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:38.971785 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:38.971861 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:38.971845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:38.972003 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:38.971956 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:38.972125 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:38.972100 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:39.146649 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:39.146611 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" event={"ID":"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d","Type":"ContainerStarted","Data":"22aeb0860de51f9b173452821134895e9cee22b0da815d8bd1fa1d3bd916e710"} Jul 16 12:39:40.152197 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.151989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" event={"ID":"05e6e89a-9cbb-4d48-81c3-2d22c6cb312d","Type":"ContainerStarted","Data":"780c0eb34447f83a0e346f87148172310899ef805f0376213d46ee4fc5539590"} Jul 16 12:39:40.170515 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.170452 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5xzw7" podStartSLOduration=6.9355624989999995 podStartE2EDuration="21.170429925s" totalImagesPullingTime="14.234867426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:38.158373294 +0000 UTC m=+19.820033376" watchObservedRunningTime="2026-07-16 12:39:40.170429925 +0000 UTC m=+21.832090009" Jul 16 12:39:40.171177 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.171129 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pq2fc" podStartSLOduration=4.482370961 podStartE2EDuration="21.171107319s" totalImagesPullingTime="16.688736358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:40.170677558 +0000 UTC m=+21.832337643" watchObservedRunningTime="2026-07-16 12:39:40.171107319 +0000 UTC m=+21.832767403" Jul 16 12:39:40.400826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.400794 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:40.401907 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.401706 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:40.970464 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.970428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:40.970653 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.970486 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:40.970653 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:40.970622 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:40.971057 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:40.971029 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:40.971174 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:40.971084 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:40.971174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:40.971161 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:41.155997 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:41.155962 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9tbsr" Jul 16 12:39:42.970981 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:42.970944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:42.971540 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:42.970999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:42.971540 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:42.970946 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:42.971540 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:42.971096 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:42.971540 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:42.971162 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:42.971540 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:42.971229 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:44.971059 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:44.971018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:44.971514 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:44.971018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:44.971514 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:44.971151 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:44.971514 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:44.971184 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:44.971514 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:44.971034 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:44.971514 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:44.971264 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:46.971105 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:46.970907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:46.971787 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:46.970940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:46.971787 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:46.971182 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:46.971787 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:46.971014 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:46.971787 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:46.971316 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:46.971787 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:46.971403 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:47.170998 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.170918 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:39:47.171270 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171250 2567 generic.go:356] "Generic (PLEG): container finished" podID="b26a799c-13a5-42ee-8f2a-9074999b181b" containerID="98c54f3ae35beb649db5cc8f274f711f140af5aa1286979292a08d69de3efcb9" exitCode=1 Jul 16 12:39:47.171353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171331 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"90acf760cae7f64decdf156b5d347cbf4c8cf9fa68cbd1126a4911c2c06fce19"} Jul 16 12:39:47.171438 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"d92fd4d3c9f47dd46243d5bc035727c885730c6980331b5cf15a4c3756b2eaa5"} Jul 16 12:39:47.171495 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171479 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"b68e4a3f69918eea3e43abfa84d89e03306cd4d03784146232eadf7ea10f2a30"} Jul 16 12:39:47.171541 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171523 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"c1686e36290e1d91da59f8c509ebed4b802a33831ebf85dad356f4b981cef17a"} Jul 16 12:39:47.171585 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerDied","Data":"98c54f3ae35beb649db5cc8f274f711f140af5aa1286979292a08d69de3efcb9"} Jul 16 12:39:47.171676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.171662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"92eef7ec3b71f54af42dc03ed7ad02701164818a63dea265523fe4617ebd0fe6"} Jul 16 12:39:47.173109 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.173087 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4427-93c7-45dc-879a-9bbe2100fa19" containerID="4f88b4c7a361919bce8bc8b0757ba1036a1789d41f7896d6a48ae82f0e1acf4b" exitCode=0 Jul 16 12:39:47.173223 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:47.173121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerDied","Data":"4f88b4c7a361919bce8bc8b0757ba1036a1789d41f7896d6a48ae82f0e1acf4b"} Jul 16 12:39:48.971285 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:48.971250 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:48.971853 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:48.971345 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:48.971853 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:48.971361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:48.971853 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:48.971442 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:48.971853 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:48.971463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:48.971853 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:48.971524 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:49.179961 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:49.179937 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:39:49.180315 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:49.180290 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"c6586942a8b8972c5c2a256fba8d32a76009af29c327b272de5eb60262d17232"} Jul 16 12:39:50.970505 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:50.970473 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:50.970914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:50.970473 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:50.970914 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:50.970600 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:50.970914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:50.970616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:50.970914 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:50.970696 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:50.970914 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:50.970793 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:52.190585 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.190407 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4427-93c7-45dc-879a-9bbe2100fa19" containerID="a74941bad3d0cf7de8b736da22c02352f0b8b8c1644f39e919b9a008ab92231e" exitCode=0 Jul 16 12:39:52.191107 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.190490 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerDied","Data":"a74941bad3d0cf7de8b736da22c02352f0b8b8c1644f39e919b9a008ab92231e"} Jul 16 12:39:52.194358 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.194285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:39:52.194623 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.194603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"478b20b3283c5789db999bc59a6b4f2dc2bee8c2ddb26c0e75e4d6d7a0c87aeb"} Jul 16 12:39:52.194928 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.194911 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:52.195017 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.194970 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:52.195151 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.195135 2567 scope.go:117] "RemoveContainer" containerID="98c54f3ae35beb649db5cc8f274f711f140af5aa1286979292a08d69de3efcb9" Jul 16 12:39:52.210502 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.210483 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:52.653818 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.653780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:52.653983 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.653827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:52.653983 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.653848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:52.653983 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.653945 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:52.653983 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.653955 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 12:39:52.653983 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.653975 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 12:39:52.653983 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.653985 2567 projected.go:196] Error preparing data for projected volume kube-api-access-wkwgp for pod openshift-network-diagnostics/network-check-target-svkwm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:52.654167 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.654005 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret podName:9334156f-b91f-4e46-be62-df2ebb2b746e nodeName:}" failed. No retries permitted until 2026-07-16 12:40:24.653990869 +0000 UTC m=+66.315650944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret") pod "global-pull-secret-syncer-n2596" (UID: "9334156f-b91f-4e46-be62-df2ebb2b746e") : object "kube-system"/"original-pull-secret" not registered Jul 16 12:39:52.654167 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.654026 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp podName:1e45d150-2eb5-4c37-b136-cb138a970e0a nodeName:}" failed. No retries permitted until 2026-07-16 12:40:24.654013859 +0000 UTC m=+66.315673933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwgp" (UniqueName: "kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp") pod "network-check-target-svkwm" (UID: "1e45d150-2eb5-4c37-b136-cb138a970e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 12:39:52.654167 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.653945 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:52.654167 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.654069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs podName:174ca112-4d79-4fba-92d3-af4b905da5f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:24.654058846 +0000 UTC m=+66.315718921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs") pod "network-metrics-daemon-w7h87" (UID: "174ca112-4d79-4fba-92d3-af4b905da5f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 12:39:52.970221 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.970151 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:52.970355 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.970151 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:52.970355 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.970268 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:52.970355 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:52.970284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:52.970447 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.970386 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:52.970494 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:52.970474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:53.202534 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.202511 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:39:53.202939 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.202872 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" event={"ID":"b26a799c-13a5-42ee-8f2a-9074999b181b","Type":"ContainerStarted","Data":"9a8338db5d44243955c40f7ce1d2a0f1bf731d59a9a4ac00d0cbc05313b84bc6"} Jul 16 12:39:53.203238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.203213 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:53.222697 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.222571 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:39:53.235000 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.234959 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" podStartSLOduration=10.931566863 podStartE2EDuration="35.234944524s" totalImagesPullingTime="24.303377661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:39:53.234593984 +0000 UTC m=+34.896254094" watchObservedRunningTime="2026-07-16 12:39:53.234944524 +0000 UTC m=+34.896604607" Jul 16 12:39:53.504979 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.504767 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svkwm"] Jul 16 12:39:53.505146 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.505063 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:53.505208 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:53.505155 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:53.507673 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.507649 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w7h87"] Jul 16 12:39:53.507807 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.507794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:53.507945 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:53.507920 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:53.508181 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.508158 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n2596"] Jul 16 12:39:53.508264 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:53.508241 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:53.508326 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:53.508310 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:54.207422 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:54.207382 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4427-93c7-45dc-879a-9bbe2100fa19" containerID="e841c5f7f6b12b08a87a1bdc1ed28e9fa012bc7479c2e3960ecfdb1ec39a5fb4" exitCode=0 Jul 16 12:39:54.207885 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:54.207470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerDied","Data":"e841c5f7f6b12b08a87a1bdc1ed28e9fa012bc7479c2e3960ecfdb1ec39a5fb4"} Jul 16 12:39:54.970508 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:54.970477 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:54.970508 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:54.970498 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:54.970774 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:54.970476 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:54.970774 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:54.970615 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:54.970774 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:54.970661 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:54.970774 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:54.970719 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:56.970767 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:56.970713 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:56.971296 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:56.970722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:56.971296 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:56.970882 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:56.971296 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:56.970890 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:56.971296 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:56.970977 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:56.971296 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:56.971067 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:58.486424 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:58.486398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4lld_2f29178a-d849-4a92-a61f-6e894e5786e0/dns-node-resolver/0.log" Jul 16 12:39:58.970966 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:58.970930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:39:58.971123 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:58.971026 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w7h87" podUID="174ca112-4d79-4fba-92d3-af4b905da5f7" Jul 16 12:39:58.971123 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:58.971101 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:39:58.971238 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:58.971185 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n2596" podUID="9334156f-b91f-4e46-be62-df2ebb2b746e" Jul 16 12:39:58.971238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:58.971228 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:39:58.971307 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:58.971281 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svkwm" podUID="1e45d150-2eb5-4c37-b136-cb138a970e0a" Jul 16 12:39:59.221365 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.221292 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4427-93c7-45dc-879a-9bbe2100fa19" containerID="d82655034ec0d6060b84cd8ec96e711e0bc50f0a14be0e0fb6820d2a0ae9c096" exitCode=0 Jul 16 12:39:59.221365 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.221337 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerDied","Data":"d82655034ec0d6060b84cd8ec96e711e0bc50f0a14be0e0fb6820d2a0ae9c096"} Jul 16 12:39:59.614109 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.614080 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeReady" Jul 16 12:39:59.614660 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.614215 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 12:39:59.659070 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.659038 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9bz5m"] Jul 16 12:39:59.664131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.664107 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-68d8z"] Jul 16 12:39:59.664277 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.664240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.666513 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.666490 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 12:39:59.666513 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.666507 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 12:39:59.666513 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.666513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4kt9r\"" Jul 16 12:39:59.669608 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.669589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.672159 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.672065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 12:39:59.672159 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.672074 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qr4zr\"" Jul 16 12:39:59.672312 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.672247 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 12:39:59.672362 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.672318 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 12:39:59.676536 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.676428 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98p2d_6ecced20-759e-4625-a40e-8e953c9da289/node-ca/0.log" Jul 16 12:39:59.677324 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.677301 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9bz5m"] Jul 16 12:39:59.678104 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.678084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-68d8z"] Jul 16 12:39:59.687440 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.687413 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bw7c4"] Jul 16 12:39:59.692816 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.692800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.697062 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.697041 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 12:39:59.697062 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.697041 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 12:39:59.697062 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.697073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9wswp\"" Jul 16 12:39:59.697305 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.697157 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 12:39:59.697753 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.697719 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 12:39:59.702275 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.702253 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bw7c4"] Jul 16 12:39:59.808828 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37af210d-b579-4255-b88d-f386e9128f79-tmp-dir\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.808828 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsh8l\" (UniqueName: \"kubernetes.io/projected/37af210d-b579-4255-b88d-f386e9128f79-kube-api-access-zsh8l\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.809046 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mhzs\" (UniqueName: \"kubernetes.io/projected/5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d-kube-api-access-7mhzs\") pod \"ingress-canary-68d8z\" (UID: \"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d\") " pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.809046 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztbnk\" (UniqueName: \"kubernetes.io/projected/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-api-access-ztbnk\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.809046 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d-cert\") pod \"ingress-canary-68d8z\" (UID: \"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d\") " pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.809046 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9639b256-b79b-4e6f-9e33-41d9249cf939-crio-socket\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.809046 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9639b256-b79b-4e6f-9e33-41d9249cf939-data-volume\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.809046 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.808954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37af210d-b579-4255-b88d-f386e9128f79-config-volume\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.809235 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.809056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.809235 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.809083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.809235 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.809103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910056 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.909972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.910056 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37af210d-b579-4255-b88d-f386e9128f79-tmp-dir\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsh8l\" (UniqueName: \"kubernetes.io/projected/37af210d-b579-4255-b88d-f386e9128f79-kube-api-access-zsh8l\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mhzs\" (UniqueName: \"kubernetes.io/projected/5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d-kube-api-access-7mhzs\") pod \"ingress-canary-68d8z\" (UID: \"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d\") " pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:59.910132 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:59.910184 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:59.910206 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls podName:37af210d-b579-4255-b88d-f386e9128f79 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:00.410186661 +0000 UTC m=+42.071846745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls") pod "dns-default-9bz5m" (UID: "37af210d-b579-4255-b88d-f386e9128f79") : secret "dns-default-metrics-tls" not found Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:59.910255 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:00.41023033 +0000 UTC m=+42.071890409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : secret "insights-runtime-extractor-tls" not found Jul 16 12:39:59.910294 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztbnk\" (UniqueName: \"kubernetes.io/projected/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-api-access-ztbnk\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d-cert\") pod \"ingress-canary-68d8z\" (UID: \"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d\") " pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9639b256-b79b-4e6f-9e33-41d9249cf939-crio-socket\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9639b256-b79b-4e6f-9e33-41d9249cf939-data-volume\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37af210d-b579-4255-b88d-f386e9128f79-config-volume\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910580 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9639b256-b79b-4e6f-9e33-41d9249cf939-crio-socket\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37af210d-b579-4255-b88d-f386e9128f79-tmp-dir\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.910633 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:59.910630 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:39:59.910897 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:39:59.910710 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:00.410693782 +0000 UTC m=+42.072353888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : configmap "kube-rbac-proxy" not found Jul 16 12:39:59.910897 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.910804 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9639b256-b79b-4e6f-9e33-41d9249cf939-data-volume\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.911026 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.911007 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37af210d-b579-4255-b88d-f386e9128f79-config-volume\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.914696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.914576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d-cert\") pod \"ingress-canary-68d8z\" (UID: \"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d\") " pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.918675 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.918644 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztbnk\" (UniqueName: \"kubernetes.io/projected/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-api-access-ztbnk\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:39:59.918804 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.918729 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsh8l\" (UniqueName: \"kubernetes.io/projected/37af210d-b579-4255-b88d-f386e9128f79-kube-api-access-zsh8l\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:39:59.918889 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.918866 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mhzs\" (UniqueName: \"kubernetes.io/projected/5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d-kube-api-access-7mhzs\") pod \"ingress-canary-68d8z\" (UID: \"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d\") " pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:39:59.981553 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:39:59.981514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-68d8z" Jul 16 12:40:00.115825 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.115346 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt"] Jul 16 12:40:00.131684 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.131653 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt"] Jul 16 12:40:00.131853 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.131716 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" Jul 16 12:40:00.134112 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.134087 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 12:40:00.134234 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.134089 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 12:40:00.134234 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.134127 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-flktt\"" Jul 16 12:40:00.167261 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.167146 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-68d8z"] Jul 16 12:40:00.171333 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:00.171303 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3404a9_3e61_4fbb_a1ab_8822c9db3a7d.slice/crio-9bd830268d97b1544edb85baaa2b16443e339db8acce722107b45b61d9434988 WatchSource:0}: Error finding container 9bd830268d97b1544edb85baaa2b16443e339db8acce722107b45b61d9434988: Status 404 returned error can't find the container with id 9bd830268d97b1544edb85baaa2b16443e339db8acce722107b45b61d9434988 Jul 16 12:40:00.213126 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.213092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4fg\" (UniqueName: \"kubernetes.io/projected/d81b0e13-6107-4d20-8334-bbb8e63a05f7-kube-api-access-sk4fg\") pod \"migrator-7f59b54f6c-dnwqt\" (UID: \"d81b0e13-6107-4d20-8334-bbb8e63a05f7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" Jul 16 12:40:00.225136 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.225101 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-68d8z" event={"ID":"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d","Type":"ContainerStarted","Data":"9bd830268d97b1544edb85baaa2b16443e339db8acce722107b45b61d9434988"} Jul 16 12:40:00.228154 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.228126 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae5a4427-93c7-45dc-879a-9bbe2100fa19" containerID="0b129e855e64cc495a6c14285d60a6ebb6d351371ed96c82912bc3db66f51168" exitCode=0 Jul 16 12:40:00.228267 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.228160 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerDied","Data":"0b129e855e64cc495a6c14285d60a6ebb6d351371ed96c82912bc3db66f51168"} Jul 16 12:40:00.314728 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.314693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4fg\" (UniqueName: \"kubernetes.io/projected/d81b0e13-6107-4d20-8334-bbb8e63a05f7-kube-api-access-sk4fg\") pod \"migrator-7f59b54f6c-dnwqt\" (UID: \"d81b0e13-6107-4d20-8334-bbb8e63a05f7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" Jul 16 12:40:00.323365 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.323339 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4fg\" (UniqueName: \"kubernetes.io/projected/d81b0e13-6107-4d20-8334-bbb8e63a05f7-kube-api-access-sk4fg\") pod \"migrator-7f59b54f6c-dnwqt\" (UID: \"d81b0e13-6107-4d20-8334-bbb8e63a05f7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" Jul 16 12:40:00.415920 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.415885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:00.415920 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.415920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.415941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:00.416006 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:00.416033 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:00.416048 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:00.416084 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:01.416068 +0000 UTC m=+43.077728060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : secret "insights-runtime-extractor-tls" not found Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:00.416126 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:01.416117695 +0000 UTC m=+43.077777757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : configmap "kube-rbac-proxy" not found Jul 16 12:40:00.416174 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:00.416141 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls podName:37af210d-b579-4255-b88d-f386e9128f79 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:01.416133217 +0000 UTC m=+43.077793277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls") pod "dns-default-9bz5m" (UID: "37af210d-b579-4255-b88d-f386e9128f79") : secret "dns-default-metrics-tls" not found Jul 16 12:40:00.442148 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.442080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" Jul 16 12:40:00.582612 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.582444 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt"] Jul 16 12:40:00.586088 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:00.586057 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81b0e13_6107_4d20_8334_bbb8e63a05f7.slice/crio-197b0916dd3a18441421702e08268cf576ccd134064f04ace191f21c1508c3ef WatchSource:0}: Error finding container 197b0916dd3a18441421702e08268cf576ccd134064f04ace191f21c1508c3ef: Status 404 returned error can't find the container with id 197b0916dd3a18441421702e08268cf576ccd134064f04ace191f21c1508c3ef Jul 16 12:40:00.971238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.971205 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:40:00.971707 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.971244 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:40:00.971707 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.971205 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:40:00.973909 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.973826 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 12:40:00.974036 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.973998 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 12:40:00.974088 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.974061 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 12:40:00.974169 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.974151 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8df2z\"" Jul 16 12:40:00.974627 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.974607 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ff9kh\"" Jul 16 12:40:00.974817 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:00.974617 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 12:40:01.234777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:01.234670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" event={"ID":"ae5a4427-93c7-45dc-879a-9bbe2100fa19","Type":"ContainerStarted","Data":"368aec8458648ecf1e8e4b3c4bcff2eed6312577e9579fa56aa3815334904fef"} Jul 16 12:40:01.237856 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:01.237823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" event={"ID":"d81b0e13-6107-4d20-8334-bbb8e63a05f7","Type":"ContainerStarted","Data":"197b0916dd3a18441421702e08268cf576ccd134064f04ace191f21c1508c3ef"} Jul 16 12:40:01.259467 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:01.259214 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x2zfh" podStartSLOduration=9.442818965 podStartE2EDuration="42.259195281s" totalImagesPullingTime="32.816376316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:01.258015213 +0000 UTC m=+42.919675293" watchObservedRunningTime="2026-07-16 12:40:01.259195281 +0000 UTC m=+42.920855365" Jul 16 12:40:01.423933 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:01.423892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:01.424088 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:01.423944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:01.424088 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:01.423977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:01.424088 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:01.424018 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:40:01.424088 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:01.424085 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:03.424070667 +0000 UTC m=+45.085730741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : configmap "kube-rbac-proxy" not found Jul 16 12:40:01.424333 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:01.424130 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:40:01.424333 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:01.424185 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls podName:37af210d-b579-4255-b88d-f386e9128f79 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:03.424172315 +0000 UTC m=+45.085832389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls") pod "dns-default-9bz5m" (UID: "37af210d-b579-4255-b88d-f386e9128f79") : secret "dns-default-metrics-tls" not found Jul 16 12:40:01.424333 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:01.424130 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:40:01.424333 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:01.424225 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:03.424214806 +0000 UTC m=+45.085874881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : secret "insights-runtime-extractor-tls" not found Jul 16 12:40:03.440890 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:03.440851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:03.440890 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:03.440894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:03.440913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:03.440993 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:03.441006 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:03.441008 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:03.441059 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:07.441044234 +0000 UTC m=+49.102704309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : secret "insights-runtime-extractor-tls" not found Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:03.441071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:07.441065631 +0000 UTC m=+49.102725692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : configmap "kube-rbac-proxy" not found Jul 16 12:40:03.441706 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:03.441080 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls podName:37af210d-b579-4255-b88d-f386e9128f79 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:07.441076009 +0000 UTC m=+49.102736070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls") pod "dns-default-9bz5m" (UID: "37af210d-b579-4255-b88d-f386e9128f79") : secret "dns-default-metrics-tls" not found Jul 16 12:40:04.017398 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.017360 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-768bc59f49-8t49s"] Jul 16 12:40:04.036461 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.036427 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768bc59f49-8t49s"] Jul 16 12:40:04.036608 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.036546 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.039069 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.039039 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 12:40:04.039069 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.039076 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 12:40:04.039069 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.039091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zz4g5\"" Jul 16 12:40:04.039350 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.039099 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 12:40:04.044302 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.044284 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 12:40:04.146653 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-installation-pull-secrets\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.146820 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146687 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-trusted-ca\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.146820 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01fe3bcf-8be0-4057-8419-7052129956a9-ca-trust-extracted\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.146820 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.146946 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-registry-certificates\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.146946 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-bound-sa-token\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.147006 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdxth\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-kube-api-access-jdxth\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.147006 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.146978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-image-registry-private-configuration\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.246831 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.246793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-68d8z" event={"ID":"5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d","Type":"ContainerStarted","Data":"c3db606d327a6887d40ab4fa72bb9e18e7a7aa5d74649903ea68fef5c8212b01"} Jul 16 12:40:04.247307 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdxth\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-kube-api-access-jdxth\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-image-registry-private-configuration\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-installation-pull-secrets\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-trusted-ca\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01fe3bcf-8be0-4057-8419-7052129956a9-ca-trust-extracted\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-registry-certificates\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247592 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.247519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-bound-sa-token\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.247803 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:04.247613 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:40:04.247803 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:04.247629 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bc59f49-8t49s: secret "image-registry-tls" not found Jul 16 12:40:04.247803 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:04.247690 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls podName:01fe3bcf-8be0-4057-8419-7052129956a9 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:04.747668848 +0000 UTC m=+46.409328920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls") pod "image-registry-768bc59f49-8t49s" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9") : secret "image-registry-tls" not found Jul 16 12:40:04.248112 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.248085 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01fe3bcf-8be0-4057-8419-7052129956a9-ca-trust-extracted\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.248465 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.248443 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-registry-certificates\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.248874 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.248846 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" event={"ID":"d81b0e13-6107-4d20-8334-bbb8e63a05f7","Type":"ContainerStarted","Data":"4764907b82fd9b728f38247d631cb90eb25a8a0b61ef30b48ccb75188b4a0d8d"} Jul 16 12:40:04.248989 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.248902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" event={"ID":"d81b0e13-6107-4d20-8334-bbb8e63a05f7","Type":"ContainerStarted","Data":"71f7264e0e2b76183e415777513f097e28a688dac389b19b3fe2dee8e71ee713"} Jul 16 12:40:04.249197 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.249175 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-trusted-ca\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.251035 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.251011 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-image-registry-private-configuration\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.251112 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.251041 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-installation-pull-secrets\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.257899 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.257875 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-bound-sa-token\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.258060 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.258038 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdxth\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-kube-api-access-jdxth\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.269647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.269553 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-68d8z" podStartSLOduration=1.879181085 podStartE2EDuration="5.269535805s" totalImagesPullingTime="3.39035472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:04.269297964 +0000 UTC m=+45.930958052" watchObservedRunningTime="2026-07-16 12:40:04.269535805 +0000 UTC m=+45.931195888" Jul 16 12:40:04.285255 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.285186 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-dnwqt" podStartSLOduration=1.60094766 podStartE2EDuration="4.285167185s" totalImagesPullingTime="2.684219525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:04.285111712 +0000 UTC m=+45.946771822" watchObservedRunningTime="2026-07-16 12:40:04.285167185 +0000 UTC m=+45.946827268" Jul 16 12:40:04.752175 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:04.752108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:04.752666 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:04.752259 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:40:04.752666 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:04.752274 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bc59f49-8t49s: secret "image-registry-tls" not found Jul 16 12:40:04.752666 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:04.752330 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls podName:01fe3bcf-8be0-4057-8419-7052129956a9 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:05.752313044 +0000 UTC m=+47.413973123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls") pod "image-registry-768bc59f49-8t49s" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9") : secret "image-registry-tls" not found Jul 16 12:40:05.759012 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:05.758974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:05.759361 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:05.759128 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:40:05.759361 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:05.759147 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bc59f49-8t49s: secret "image-registry-tls" not found Jul 16 12:40:05.759361 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:05.759220 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls podName:01fe3bcf-8be0-4057-8419-7052129956a9 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:07.759204906 +0000 UTC m=+49.420864996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls") pod "image-registry-768bc59f49-8t49s" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9") : secret "image-registry-tls" not found Jul 16 12:40:06.313263 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.313230 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-5p766"] Jul 16 12:40:06.348199 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.348164 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-5p766"] Jul 16 12:40:06.348327 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.348293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.350882 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.350860 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 12:40:06.351637 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.351620 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 12:40:06.351749 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.351639 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 12:40:06.351749 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.351694 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 12:40:06.351911 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.351898 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dsll9\"" Jul 16 12:40:06.463560 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.463520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8e86f48-67ef-434a-ac96-c63b97afdd85-signing-cabundle\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.463703 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.463585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8e86f48-67ef-434a-ac96-c63b97afdd85-signing-key\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.463703 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.463643 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jr2\" (UniqueName: \"kubernetes.io/projected/d8e86f48-67ef-434a-ac96-c63b97afdd85-kube-api-access-77jr2\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.564507 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.564419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8e86f48-67ef-434a-ac96-c63b97afdd85-signing-cabundle\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.564507 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.564481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8e86f48-67ef-434a-ac96-c63b97afdd85-signing-key\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.564717 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.564592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jr2\" (UniqueName: \"kubernetes.io/projected/d8e86f48-67ef-434a-ac96-c63b97afdd85-kube-api-access-77jr2\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.565304 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.565131 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8e86f48-67ef-434a-ac96-c63b97afdd85-signing-cabundle\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.567090 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.567071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8e86f48-67ef-434a-ac96-c63b97afdd85-signing-key\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.582489 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.582458 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jr2\" (UniqueName: \"kubernetes.io/projected/d8e86f48-67ef-434a-ac96-c63b97afdd85-kube-api-access-77jr2\") pod \"service-ca-79f68b9f4f-5p766\" (UID: \"d8e86f48-67ef-434a-ac96-c63b97afdd85\") " pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.660025 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.659984 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" Jul 16 12:40:06.794872 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:06.794841 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-5p766"] Jul 16 12:40:06.799396 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:06.799372 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e86f48_67ef_434a_ac96_c63b97afdd85.slice/crio-d8e0eaca1b7f190b8891c7954c3eb04e08e5477dab8196f96823873c1712edd8 WatchSource:0}: Error finding container d8e0eaca1b7f190b8891c7954c3eb04e08e5477dab8196f96823873c1712edd8: Status 404 returned error can't find the container with id d8e0eaca1b7f190b8891c7954c3eb04e08e5477dab8196f96823873c1712edd8 Jul 16 12:40:07.257028 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:07.256989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" event={"ID":"d8e86f48-67ef-434a-ac96-c63b97afdd85","Type":"ContainerStarted","Data":"d8e0eaca1b7f190b8891c7954c3eb04e08e5477dab8196f96823873c1712edd8"} Jul 16 12:40:07.471456 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:07.471414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:07.471456 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:07.471460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:07.471696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:07.471488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:07.471696 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.471543 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 12:40:07.471696 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.471596 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 12:40:07.471696 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.471616 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:15.471601113 +0000 UTC m=+57.133261191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : configmap "kube-rbac-proxy" not found Jul 16 12:40:07.471696 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.471658 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls podName:37af210d-b579-4255-b88d-f386e9128f79 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:15.4716463 +0000 UTC m=+57.133306380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls") pod "dns-default-9bz5m" (UID: "37af210d-b579-4255-b88d-f386e9128f79") : secret "dns-default-metrics-tls" not found Jul 16 12:40:07.471696 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.471669 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:40:07.471938 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.471725 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:15.471709755 +0000 UTC m=+57.133369830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : secret "insights-runtime-extractor-tls" not found Jul 16 12:40:07.773977 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:07.773934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:07.774183 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.774062 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:40:07.774183 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.774086 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bc59f49-8t49s: secret "image-registry-tls" not found Jul 16 12:40:07.774183 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:07.774169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls podName:01fe3bcf-8be0-4057-8419-7052129956a9 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:11.7741492 +0000 UTC m=+53.435809277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls") pod "image-registry-768bc59f49-8t49s" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9") : secret "image-registry-tls" not found Jul 16 12:40:10.266947 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:10.266763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" event={"ID":"d8e86f48-67ef-434a-ac96-c63b97afdd85","Type":"ContainerStarted","Data":"84471c3c645451e35c8ce9112f957ccb28126da8d6fc2289e76789eba253a1ac"} Jul 16 12:40:10.282091 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:10.282036 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-5p766" podStartSLOduration=1.5570516730000001 podStartE2EDuration="4.282019328s" totalImagesPullingTime="2.724967655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:10.281388038 +0000 UTC m=+51.943048118" watchObservedRunningTime="2026-07-16 12:40:10.282019328 +0000 UTC m=+51.943679410" Jul 16 12:40:11.807322 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:11.807274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:11.807804 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:11.807404 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 12:40:11.807804 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:11.807425 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bc59f49-8t49s: secret "image-registry-tls" not found Jul 16 12:40:11.807804 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:11.807482 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls podName:01fe3bcf-8be0-4057-8419-7052129956a9 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:19.807468838 +0000 UTC m=+61.469128898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls") pod "image-registry-768bc59f49-8t49s" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9") : secret "image-registry-tls" not found Jul 16 12:40:15.532357 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.532316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:15.532357 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.532360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:15.532877 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.532381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:15.532877 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:15.532472 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 12:40:15.532877 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:15.532531 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls podName:9639b256-b79b-4e6f-9e33-41d9249cf939 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:31.532517268 +0000 UTC m=+73.194177343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw7c4" (UID: "9639b256-b79b-4e6f-9e33-41d9249cf939") : secret "insights-runtime-extractor-tls" not found Jul 16 12:40:15.533098 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.532985 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9639b256-b79b-4e6f-9e33-41d9249cf939-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:15.536386 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.536361 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37af210d-b579-4255-b88d-f386e9128f79-metrics-tls\") pod \"dns-default-9bz5m\" (UID: \"37af210d-b579-4255-b88d-f386e9128f79\") " pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:15.574172 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.574141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:15.717768 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:15.717719 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9bz5m"] Jul 16 12:40:15.720645 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:15.720613 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37af210d_b579_4255_b88d_f386e9128f79.slice/crio-f44b89ec9b648af03a4958290f4e93005d78c53f1151f52d2753249c1f015a43 WatchSource:0}: Error finding container f44b89ec9b648af03a4958290f4e93005d78c53f1151f52d2753249c1f015a43: Status 404 returned error can't find the container with id f44b89ec9b648af03a4958290f4e93005d78c53f1151f52d2753249c1f015a43 Jul 16 12:40:16.283609 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:16.283580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9bz5m" event={"ID":"37af210d-b579-4255-b88d-f386e9128f79","Type":"ContainerStarted","Data":"f44b89ec9b648af03a4958290f4e93005d78c53f1151f52d2753249c1f015a43"} Jul 16 12:40:19.299816 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:19.299784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9bz5m" event={"ID":"37af210d-b579-4255-b88d-f386e9128f79","Type":"ContainerStarted","Data":"911604d458c5d4a9f26d8a9596510c321f145a9680ec8ca345f7f03901538c0d"} Jul 16 12:40:19.867927 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:19.867894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:19.870256 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:19.870231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"image-registry-768bc59f49-8t49s\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:19.948919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:19.948886 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zz4g5\"" Jul 16 12:40:19.956822 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:19.956794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:20.107547 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.107423 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768bc59f49-8t49s"] Jul 16 12:40:20.110500 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:20.110464 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fe3bcf_8be0_4057_8419_7052129956a9.slice/crio-86e86b5ad3c36acc170b58cc4cd6aaa6c3eefa10d61bf5b7765829822de7a178 WatchSource:0}: Error finding container 86e86b5ad3c36acc170b58cc4cd6aaa6c3eefa10d61bf5b7765829822de7a178: Status 404 returned error can't find the container with id 86e86b5ad3c36acc170b58cc4cd6aaa6c3eefa10d61bf5b7765829822de7a178 Jul 16 12:40:20.305471 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.305424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9bz5m" event={"ID":"37af210d-b579-4255-b88d-f386e9128f79","Type":"ContainerStarted","Data":"c3d094b1ffbc2c79656b654f5d5a8207cd4f12949804091887add4b830f53afa"} Jul 16 12:40:20.305916 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.305524 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:20.306914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.306892 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" event={"ID":"01fe3bcf-8be0-4057-8419-7052129956a9","Type":"ContainerStarted","Data":"64c5153c606afdc99a8add3638a13b950be2c6ef0340c2862de969803d9d0d6d"} Jul 16 12:40:20.307080 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.306930 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" event={"ID":"01fe3bcf-8be0-4057-8419-7052129956a9","Type":"ContainerStarted","Data":"86e86b5ad3c36acc170b58cc4cd6aaa6c3eefa10d61bf5b7765829822de7a178"} Jul 16 12:40:20.307080 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.306965 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:20.329548 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.329497 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9bz5m" podStartSLOduration=17.936760431 podStartE2EDuration="21.329480647s" totalImagesPullingTime="3.392720216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:20.32846538 +0000 UTC m=+61.990125462" watchObservedRunningTime="2026-07-16 12:40:20.329480647 +0000 UTC m=+61.991140722" Jul 16 12:40:20.351642 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:20.351596 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" podStartSLOduration=16.351580387 podStartE2EDuration="16.351580387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:20.351202511 +0000 UTC m=+62.012862591" watchObservedRunningTime="2026-07-16 12:40:20.351580387 +0000 UTC m=+62.013240470" Jul 16 12:40:24.705833 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.705779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:40:24.705833 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.705843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:40:24.706364 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.705864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:40:24.708643 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.708623 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 12:40:24.709721 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.709706 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 12:40:24.709773 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.709711 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 12:40:24.718994 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.718961 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9334156f-b91f-4e46-be62-df2ebb2b746e-original-pull-secret\") pod \"global-pull-secret-syncer-n2596\" (UID: \"9334156f-b91f-4e46-be62-df2ebb2b746e\") " pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:40:24.719129 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.719114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174ca112-4d79-4fba-92d3-af4b905da5f7-metrics-certs\") pod \"network-metrics-daemon-w7h87\" (UID: \"174ca112-4d79-4fba-92d3-af4b905da5f7\") " pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:40:24.719183 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.719171 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 12:40:24.729149 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.729127 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwgp\" (UniqueName: \"kubernetes.io/projected/1e45d150-2eb5-4c37-b136-cb138a970e0a-kube-api-access-wkwgp\") pod \"network-check-target-svkwm\" (UID: \"1e45d150-2eb5-4c37-b136-cb138a970e0a\") " pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:40:24.983095 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.983014 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n2596" Jul 16 12:40:24.993100 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.993073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8df2z\"" Jul 16 12:40:24.997921 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:24.997895 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ff9kh\"" Jul 16 12:40:25.001584 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.001564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w7h87" Jul 16 12:40:25.006591 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.006567 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:40:25.130344 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.130298 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n2596"] Jul 16 12:40:25.132411 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:25.132379 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9334156f_b91f_4e46_be62_df2ebb2b746e.slice/crio-8c4a798f76ac49406ac011baa20330fcc65161c598fb38165537f40e67ea36a7 WatchSource:0}: Error finding container 8c4a798f76ac49406ac011baa20330fcc65161c598fb38165537f40e67ea36a7: Status 404 returned error can't find the container with id 8c4a798f76ac49406ac011baa20330fcc65161c598fb38165537f40e67ea36a7 Jul 16 12:40:25.148812 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.148655 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w7h87"] Jul 16 12:40:25.151192 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:25.151167 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174ca112_4d79_4fba_92d3_af4b905da5f7.slice/crio-550bd615159c534ee124ad416ff4c2adebe3ef5af3442ed850f975fa6973d4e9 WatchSource:0}: Error finding container 550bd615159c534ee124ad416ff4c2adebe3ef5af3442ed850f975fa6973d4e9: Status 404 returned error can't find the container with id 550bd615159c534ee124ad416ff4c2adebe3ef5af3442ed850f975fa6973d4e9 Jul 16 12:40:25.163373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.163346 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svkwm"] Jul 16 12:40:25.166175 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:25.166147 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e45d150_2eb5_4c37_b136_cb138a970e0a.slice/crio-45b6b8d124071278b56d2bcb9963a509f85c7b19d014607e0a1313b515350ddc WatchSource:0}: Error finding container 45b6b8d124071278b56d2bcb9963a509f85c7b19d014607e0a1313b515350ddc: Status 404 returned error can't find the container with id 45b6b8d124071278b56d2bcb9963a509f85c7b19d014607e0a1313b515350ddc Jul 16 12:40:25.221012 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.220982 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtxb9" Jul 16 12:40:25.323582 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.323480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w7h87" event={"ID":"174ca112-4d79-4fba-92d3-af4b905da5f7","Type":"ContainerStarted","Data":"550bd615159c534ee124ad416ff4c2adebe3ef5af3442ed850f975fa6973d4e9"} Jul 16 12:40:25.324454 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.324430 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n2596" event={"ID":"9334156f-b91f-4e46-be62-df2ebb2b746e","Type":"ContainerStarted","Data":"8c4a798f76ac49406ac011baa20330fcc65161c598fb38165537f40e67ea36a7"} Jul 16 12:40:25.325455 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:25.325434 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svkwm" event={"ID":"1e45d150-2eb5-4c37-b136-cb138a970e0a","Type":"ContainerStarted","Data":"45b6b8d124071278b56d2bcb9963a509f85c7b19d014607e0a1313b515350ddc"} Jul 16 12:40:30.312645 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.312607 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9bz5m" Jul 16 12:40:30.345536 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.345504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w7h87" event={"ID":"174ca112-4d79-4fba-92d3-af4b905da5f7","Type":"ContainerStarted","Data":"f90fe20e1e5b9e6c8ee26a05a0bd0344837eddfec13dda140ad019ea77ff95b7"} Jul 16 12:40:30.345711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.345558 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w7h87" event={"ID":"174ca112-4d79-4fba-92d3-af4b905da5f7","Type":"ContainerStarted","Data":"e2f5297edc29190df8d4d84aa256a07be1183f2a12118035af2d0da24935932b"} Jul 16 12:40:30.347012 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.346985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n2596" event={"ID":"9334156f-b91f-4e46-be62-df2ebb2b746e","Type":"ContainerStarted","Data":"960d4d7a5ab2f912d96235cdcd4522852a4e579f36a4d00d3bf85b1ff8fdbb8d"} Jul 16 12:40:30.348279 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.348260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svkwm" event={"ID":"1e45d150-2eb5-4c37-b136-cb138a970e0a","Type":"ContainerStarted","Data":"4fd8b7f16a3a6e1105e5382fcd61cfc7e5dd08a6d73ae06f22a6cd0ee29ec5fd"} Jul 16 12:40:30.348404 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.348389 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:40:30.365893 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.365849 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w7h87" podStartSLOduration=67.913456627 podStartE2EDuration="1m12.365835441s" totalImagesPullingTime="4.452378814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:30.364966767 +0000 UTC m=+72.026626850" watchObservedRunningTime="2026-07-16 12:40:30.365835441 +0000 UTC m=+72.027495521" Jul 16 12:40:30.383189 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.383146 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-svkwm" podStartSLOduration=67.934720773 podStartE2EDuration="1m12.383131768s" totalImagesPullingTime="4.448410995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:30.382161361 +0000 UTC m=+72.043821444" watchObservedRunningTime="2026-07-16 12:40:30.383131768 +0000 UTC m=+72.044791851" Jul 16 12:40:30.515198 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.515147 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n2596" podStartSLOduration=67.031007342 podStartE2EDuration="1m11.515128502s" totalImagesPullingTime="4.48412116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:30.411114434 +0000 UTC m=+72.072774516" watchObservedRunningTime="2026-07-16 12:40:30.515128502 +0000 UTC m=+72.176788562" Jul 16 12:40:30.515569 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.515553 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w"] Jul 16 12:40:30.517493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.517479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.521601 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.521565 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 12:40:30.521758 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.521601 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 12:40:30.521829 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.521802 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nlr72\"" Jul 16 12:40:30.521893 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.521845 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 12:40:30.522089 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.522056 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 12:40:30.523371 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.523354 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768bc59f49-8t49s"] Jul 16 12:40:30.536751 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.536720 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w"] Jul 16 12:40:30.556806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.556776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05e7e200-565c-40db-b6e6-74eee86e3e9a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-576dc5c4-m4j2w\" (UID: \"05e7e200-565c-40db-b6e6-74eee86e3e9a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.556973 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.556834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps7mb\" (UniqueName: \"kubernetes.io/projected/05e7e200-565c-40db-b6e6-74eee86e3e9a-kube-api-access-ps7mb\") pod \"managed-serviceaccount-addon-agent-576dc5c4-m4j2w\" (UID: \"05e7e200-565c-40db-b6e6-74eee86e3e9a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.593212 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.593121 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt"] Jul 16 12:40:30.595305 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.595284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:30.598093 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.598071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 12:40:30.598223 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.598184 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7rw8d\"" Jul 16 12:40:30.605929 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.605908 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt"] Jul 16 12:40:30.658198 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.658164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05e7e200-565c-40db-b6e6-74eee86e3e9a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-576dc5c4-m4j2w\" (UID: \"05e7e200-565c-40db-b6e6-74eee86e3e9a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.658198 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.658201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps7mb\" (UniqueName: \"kubernetes.io/projected/05e7e200-565c-40db-b6e6-74eee86e3e9a-kube-api-access-ps7mb\") pod \"managed-serviceaccount-addon-agent-576dc5c4-m4j2w\" (UID: \"05e7e200-565c-40db-b6e6-74eee86e3e9a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.658441 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.658259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee50606f-68b6-41d8-b2c4-b3791913ad63-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-24mqt\" (UID: \"ee50606f-68b6-41d8-b2c4-b3791913ad63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:30.660797 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.660771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05e7e200-565c-40db-b6e6-74eee86e3e9a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-576dc5c4-m4j2w\" (UID: \"05e7e200-565c-40db-b6e6-74eee86e3e9a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.666580 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.666553 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps7mb\" (UniqueName: \"kubernetes.io/projected/05e7e200-565c-40db-b6e6-74eee86e3e9a-kube-api-access-ps7mb\") pod \"managed-serviceaccount-addon-agent-576dc5c4-m4j2w\" (UID: \"05e7e200-565c-40db-b6e6-74eee86e3e9a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.759493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.759460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee50606f-68b6-41d8-b2c4-b3791913ad63-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-24mqt\" (UID: \"ee50606f-68b6-41d8-b2c4-b3791913ad63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:30.761788 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.761767 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee50606f-68b6-41d8-b2c4-b3791913ad63-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-24mqt\" (UID: \"ee50606f-68b6-41d8-b2c4-b3791913ad63\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:30.835568 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.835533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" Jul 16 12:40:30.904447 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.904420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:30.968651 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:30.968617 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w"] Jul 16 12:40:30.972396 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:30.972365 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05e7e200_565c_40db_b6e6_74eee86e3e9a.slice/crio-1d6a05a6b670887ba9f8c8e02bb19af41fecd0ef23b5c5c6c29d110568945a66 WatchSource:0}: Error finding container 1d6a05a6b670887ba9f8c8e02bb19af41fecd0ef23b5c5c6c29d110568945a66: Status 404 returned error can't find the container with id 1d6a05a6b670887ba9f8c8e02bb19af41fecd0ef23b5c5c6c29d110568945a66 Jul 16 12:40:31.033512 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.033486 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt"] Jul 16 12:40:31.036048 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:31.036015 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee50606f_68b6_41d8_b2c4_b3791913ad63.slice/crio-52e1c48ddfb1c79476d3fc964e79d92539ca4992fe601ed437f40bb6d3844a58 WatchSource:0}: Error finding container 52e1c48ddfb1c79476d3fc964e79d92539ca4992fe601ed437f40bb6d3844a58: Status 404 returned error can't find the container with id 52e1c48ddfb1c79476d3fc964e79d92539ca4992fe601ed437f40bb6d3844a58 Jul 16 12:40:31.353967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.353933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" event={"ID":"ee50606f-68b6-41d8-b2c4-b3791913ad63","Type":"ContainerStarted","Data":"52e1c48ddfb1c79476d3fc964e79d92539ca4992fe601ed437f40bb6d3844a58"} Jul 16 12:40:31.355143 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.355114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" event={"ID":"05e7e200-565c-40db-b6e6-74eee86e3e9a","Type":"ContainerStarted","Data":"1d6a05a6b670887ba9f8c8e02bb19af41fecd0ef23b5c5c6c29d110568945a66"} Jul 16 12:40:31.566384 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.566329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:31.568655 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.568632 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9639b256-b79b-4e6f-9e33-41d9249cf939-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw7c4\" (UID: \"9639b256-b79b-4e6f-9e33-41d9249cf939\") " pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:31.803009 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.802906 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9wswp\"" Jul 16 12:40:31.811137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.810866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bw7c4" Jul 16 12:40:31.987311 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:31.987107 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bw7c4"] Jul 16 12:40:31.990217 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:31.990181 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9639b256_b79b_4e6f_9e33_41d9249cf939.slice/crio-db3e64bf0e1c9b9c8f3fae0f1d617a5b1c525de3bb20c4e310ab114560a35bc5 WatchSource:0}: Error finding container db3e64bf0e1c9b9c8f3fae0f1d617a5b1c525de3bb20c4e310ab114560a35bc5: Status 404 returned error can't find the container with id db3e64bf0e1c9b9c8f3fae0f1d617a5b1c525de3bb20c4e310ab114560a35bc5 Jul 16 12:40:32.360837 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:32.360801 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw7c4" event={"ID":"9639b256-b79b-4e6f-9e33-41d9249cf939","Type":"ContainerStarted","Data":"db3e64bf0e1c9b9c8f3fae0f1d617a5b1c525de3bb20c4e310ab114560a35bc5"} Jul 16 12:40:34.369403 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:34.369362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" event={"ID":"ee50606f-68b6-41d8-b2c4-b3791913ad63","Type":"ContainerStarted","Data":"2e736bf8e2fb0a0de2d818bce786b610ce594c1c022658269376db3a8573e74f"} Jul 16 12:40:34.369863 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:34.369564 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:34.375157 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:34.375130 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" Jul 16 12:40:34.384611 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:34.384557 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24mqt" podStartSLOduration=1.410228982 podStartE2EDuration="4.384542183s" totalImagesPullingTime="2.974313201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:34.384062211 +0000 UTC m=+76.045722295" watchObservedRunningTime="2026-07-16 12:40:34.384542183 +0000 UTC m=+76.046202265" Jul 16 12:40:35.374418 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:35.374369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" event={"ID":"05e7e200-565c-40db-b6e6-74eee86e3e9a","Type":"ContainerStarted","Data":"e77c7192e068540c8af3a1bcf2b4aef581353e2900f8a5e045ade1fad95d974c"} Jul 16 12:40:35.392273 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:35.392213 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-576dc5c4-m4j2w" podStartSLOduration=1.8500874440000001 podStartE2EDuration="5.392191127s" totalImagesPullingTime="3.542103683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:35.391392578 +0000 UTC m=+77.053052664" watchObservedRunningTime="2026-07-16 12:40:35.392191127 +0000 UTC m=+77.053851248" Jul 16 12:40:38.387281 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:38.387246 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw7c4" event={"ID":"9639b256-b79b-4e6f-9e33-41d9249cf939","Type":"ContainerStarted","Data":"118aa378b21bce9197428555c21812e12fd41f45f676fd84e338c019594ce4ca"} Jul 16 12:40:39.093265 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.093224 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-tz9hc"] Jul 16 12:40:39.095691 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.095665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:40:39.099309 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.099285 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 12:40:39.099436 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.099341 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 12:40:39.099498 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.099345 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6qn7b\"" Jul 16 12:40:39.109226 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.109193 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-tz9hc"] Jul 16 12:40:39.228990 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.228950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tpjm\" (UniqueName: \"kubernetes.io/projected/f548ed0a-c0e4-4e7d-83bb-80a796182f78-kube-api-access-7tpjm\") pod \"downloads-68c9cbb497-tz9hc\" (UID: \"f548ed0a-c0e4-4e7d-83bb-80a796182f78\") " pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:40:39.330406 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.330363 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpjm\" (UniqueName: \"kubernetes.io/projected/f548ed0a-c0e4-4e7d-83bb-80a796182f78-kube-api-access-7tpjm\") pod \"downloads-68c9cbb497-tz9hc\" (UID: \"f548ed0a-c0e4-4e7d-83bb-80a796182f78\") " pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:40:39.343009 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.342136 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tpjm\" (UniqueName: \"kubernetes.io/projected/f548ed0a-c0e4-4e7d-83bb-80a796182f78-kube-api-access-7tpjm\") pod \"downloads-68c9cbb497-tz9hc\" (UID: \"f548ed0a-c0e4-4e7d-83bb-80a796182f78\") " pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:40:39.410754 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.410687 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:40:39.577473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:39.577397 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-tz9hc"] Jul 16 12:40:39.582433 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:39.582403 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf548ed0a_c0e4_4e7d_83bb_80a796182f78.slice/crio-3fe98e329a63c916746e589dabb865a5b75b5867614c1be44cfe7da3de385027 WatchSource:0}: Error finding container 3fe98e329a63c916746e589dabb865a5b75b5867614c1be44cfe7da3de385027: Status 404 returned error can't find the container with id 3fe98e329a63c916746e589dabb865a5b75b5867614c1be44cfe7da3de385027 Jul 16 12:40:40.397217 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:40.397099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-tz9hc" event={"ID":"f548ed0a-c0e4-4e7d-83bb-80a796182f78","Type":"ContainerStarted","Data":"3fe98e329a63c916746e589dabb865a5b75b5867614c1be44cfe7da3de385027"} Jul 16 12:40:40.531339 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:40.531307 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:40:41.295602 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.294511 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm"] Jul 16 12:40:41.312291 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.312188 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-knsk6"] Jul 16 12:40:41.312756 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.312703 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.316500 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.316473 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 12:40:41.316914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.316723 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 12:40:41.317447 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.317196 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 12:40:41.317447 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.317281 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 12:40:41.317447 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.317441 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-knhtn\"" Jul 16 12:40:41.317697 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.317507 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 12:40:41.317997 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.317975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.320217 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.320101 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 12:40:41.320217 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.320118 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 12:40:41.320616 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.320602 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jsphr\"" Jul 16 12:40:41.320704 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.320627 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 12:40:41.321501 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.321469 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm"] Jul 16 12:40:41.447817 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.447728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c4fe875-c772-4d8c-811b-24c0f704507f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.447817 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.447808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c4fe875-c772-4d8c-811b-24c0f704507f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.448072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.447944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c4fe875-c772-4d8c-811b-24c0f704507f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.448072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.447976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm7mh\" (UniqueName: \"kubernetes.io/projected/2983b61d-dc0b-466e-b243-d2a87c233185-kube-api-access-dm7mh\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.447993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd7nm\" (UniqueName: \"kubernetes.io/projected/5c4fe875-c772-4d8c-811b-24c0f704507f-kube-api-access-sd7nm\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.448072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-wtmp\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-sys\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-root\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-tls\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-accelerators-collector-config\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-textfile\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.448373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.448173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2983b61d-dc0b-466e-b243-d2a87c233185-metrics-client-ca\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549207 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-textfile\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549207 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2983b61d-dc0b-466e-b243-d2a87c233185-metrics-client-ca\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c4fe875-c772-4d8c-811b-24c0f704507f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c4fe875-c772-4d8c-811b-24c0f704507f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c4fe875-c772-4d8c-811b-24c0f704507f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm7mh\" (UniqueName: \"kubernetes.io/projected/2983b61d-dc0b-466e-b243-d2a87c233185-kube-api-access-dm7mh\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd7nm\" (UniqueName: \"kubernetes.io/projected/5c4fe875-c772-4d8c-811b-24c0f704507f-kube-api-access-sd7nm\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-wtmp\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-sys\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549502 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-textfile\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-root\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-tls\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.549764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-accelerators-collector-config\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.550562 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549820 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2983b61d-dc0b-466e-b243-d2a87c233185-metrics-client-ca\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.550562 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549970 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-sys\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.550562 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.549975 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-root\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.550562 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.550110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-wtmp\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.550562 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.550167 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-accelerators-collector-config\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.550894 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.550848 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c4fe875-c772-4d8c-811b-24c0f704507f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.553414 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.553368 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c4fe875-c772-4d8c-811b-24c0f704507f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.555277 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.555231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-tls\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.559127 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.559069 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2983b61d-dc0b-466e-b243-d2a87c233185-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.559127 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.559082 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c4fe875-c772-4d8c-811b-24c0f704507f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.561864 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.561818 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd7nm\" (UniqueName: \"kubernetes.io/projected/5c4fe875-c772-4d8c-811b-24c0f704507f-kube-api-access-sd7nm\") pod \"openshift-state-metrics-84bd68b896-phmpm\" (UID: \"5c4fe875-c772-4d8c-811b-24c0f704507f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.565036 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.564990 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm7mh\" (UniqueName: \"kubernetes.io/projected/2983b61d-dc0b-466e-b243-d2a87c233185-kube-api-access-dm7mh\") pod \"node-exporter-knsk6\" (UID: \"2983b61d-dc0b-466e-b243-d2a87c233185\") " pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:41.635098 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.634944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" Jul 16 12:40:41.642117 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:41.642084 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-knsk6" Jul 16 12:40:42.296677 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.294767 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:40:42.305026 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.304994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.307683 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.307656 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 12:40:42.307925 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.307898 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 12:40:42.308251 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.308236 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 12:40:42.308420 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.308406 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 12:40:42.308597 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.308579 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8hkpz\"" Jul 16 12:40:42.308826 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.308790 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 12:40:42.309040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.309024 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 12:40:42.309220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.309204 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 12:40:42.309403 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.309388 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 12:40:42.309587 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.309574 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 12:40:42.317186 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.317158 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:40:42.355937 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.355895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356114 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.355983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356114 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356114 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356280 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356280 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356280 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356280 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356239 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr84p\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-kube-api-access-pr84p\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-web-config\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-config-out\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.356473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.356392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.456882 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.456838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457060 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.456891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457060 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457060 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:42.457037 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 12:40:42.457211 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:42.457135 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls podName:4f379583-9bff-4064-a1a0-fec12366e777 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:42.957112298 +0000 UTC m=+84.618772373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4f379583-9bff-4064-a1a0-fec12366e777") : secret "alertmanager-main-tls" not found Jul 16 12:40:42.457391 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr84p\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-kube-api-access-pr84p\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-web-config\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-config-out\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457557 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457959 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.457696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.457959 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:40:42.457822 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle podName:4f379583-9bff-4064-a1a0-fec12366e777 nodeName:}" failed. No retries permitted until 2026-07-16 12:40:42.957802282 +0000 UTC m=+84.619462358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4f379583-9bff-4064-a1a0-fec12366e777") : configmap references non-existent config key: ca-bundle.crt Jul 16 12:40:42.459155 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.458790 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.459155 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.458953 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.461159 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.461135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.461706 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.461682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.464919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.464230 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-web-config\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.464919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.464265 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.464919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.464428 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.464919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.464667 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.464919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.464885 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-config-out\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.466244 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.466221 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr84p\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-kube-api-access-pr84p\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.466644 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.466624 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.583009 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:42.582935 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2983b61d_dc0b_466e_b243_d2a87c233185.slice/crio-37ae268f7d460e13ad755971a1ce9d2963cb5749b6942bbb89245be9079b4756 WatchSource:0}: Error finding container 37ae268f7d460e13ad755971a1ce9d2963cb5749b6942bbb89245be9079b4756: Status 404 returned error can't find the container with id 37ae268f7d460e13ad755971a1ce9d2963cb5749b6942bbb89245be9079b4756 Jul 16 12:40:42.760397 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.760359 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm"] Jul 16 12:40:42.764022 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:42.763992 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4fe875_c772_4d8c_811b_24c0f704507f.slice/crio-24c411f8edc50fd9017403068ab08145187f03de71ebaeeb0f5eb228867dfeba WatchSource:0}: Error finding container 24c411f8edc50fd9017403068ab08145187f03de71ebaeeb0f5eb228867dfeba: Status 404 returned error can't find the container with id 24c411f8edc50fd9017403068ab08145187f03de71ebaeeb0f5eb228867dfeba Jul 16 12:40:42.964905 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.964863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.965102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.964918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.965999 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.965971 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:42.967992 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:42.967966 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:43.223244 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.223213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:40:43.327419 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.327382 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-774995c767-jwwmx"] Jul 16 12:40:43.330299 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.330272 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.333064 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.332929 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 12:40:43.333545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.333263 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 12:40:43.333545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.333326 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 12:40:43.333545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.333335 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4hdjr\"" Jul 16 12:40:43.333545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.333271 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4k57ffogg17vl\"" Jul 16 12:40:43.333545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.333409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 12:40:43.333545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.333547 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 12:40:43.344648 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.344624 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-774995c767-jwwmx"] Jul 16 12:40:43.380063 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.380037 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:40:43.382635 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:43.382608 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f379583_9bff_4064_a1a0_fec12366e777.slice/crio-08a90fec9916ae094bfa4788e95673606b92396c1f554502a86877e314ba9ed7 WatchSource:0}: Error finding container 08a90fec9916ae094bfa4788e95673606b92396c1f554502a86877e314ba9ed7: Status 404 returned error can't find the container with id 08a90fec9916ae094bfa4788e95673606b92396c1f554502a86877e314ba9ed7 Jul 16 12:40:43.411639 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.411602 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knsk6" event={"ID":"2983b61d-dc0b-466e-b243-d2a87c233185","Type":"ContainerStarted","Data":"37ae268f7d460e13ad755971a1ce9d2963cb5749b6942bbb89245be9079b4756"} Jul 16 12:40:43.413881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.413848 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" event={"ID":"5c4fe875-c772-4d8c-811b-24c0f704507f","Type":"ContainerStarted","Data":"204b8314653e29b040798d161519c83c20f0d866c776b5d90ec241beb316bb34"} Jul 16 12:40:43.414021 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.413914 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" event={"ID":"5c4fe875-c772-4d8c-811b-24c0f704507f","Type":"ContainerStarted","Data":"aa8494f69eab377a8d3a0c9eafac73e06b855fcc86fbb404d62576cc9751fb7e"} Jul 16 12:40:43.414021 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.413945 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" event={"ID":"5c4fe875-c772-4d8c-811b-24c0f704507f","Type":"ContainerStarted","Data":"24c411f8edc50fd9017403068ab08145187f03de71ebaeeb0f5eb228867dfeba"} Jul 16 12:40:43.415967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.415940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw7c4" event={"ID":"9639b256-b79b-4e6f-9e33-41d9249cf939","Type":"ContainerStarted","Data":"285f542c86abbf9add162ae0c53e6d23cb1937d2feb19c60ca474e2a515eefd9"} Jul 16 12:40:43.417282 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.417257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"08a90fec9916ae094bfa4788e95673606b92396c1f554502a86877e314ba9ed7"} Jul 16 12:40:43.468482 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468482 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de610a16-a14c-4048-b894-852c8f5660e1-metrics-client-ca\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-grpc-tls\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6s7x\" (UniqueName: \"kubernetes.io/projected/de610a16-a14c-4048-b894-852c8f5660e1-kube-api-access-z6s7x\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-tls\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.468711 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.468700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.569777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.569777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.570005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.570005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de610a16-a14c-4048-b894-852c8f5660e1-metrics-client-ca\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.570005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569861 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-grpc-tls\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.570005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6s7x\" (UniqueName: \"kubernetes.io/projected/de610a16-a14c-4048-b894-852c8f5660e1-kube-api-access-z6s7x\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.570005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-tls\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.570005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.569970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.571311 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.571250 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de610a16-a14c-4048-b894-852c8f5660e1-metrics-client-ca\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.573888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.573392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.573888 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.573838 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.574467 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.574174 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.574467 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.574429 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.575357 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.575311 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-grpc-tls\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.576560 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.576538 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/de610a16-a14c-4048-b894-852c8f5660e1-secret-thanos-querier-tls\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.580928 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.580884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6s7x\" (UniqueName: \"kubernetes.io/projected/de610a16-a14c-4048-b894-852c8f5660e1-kube-api-access-z6s7x\") pod \"thanos-querier-774995c767-jwwmx\" (UID: \"de610a16-a14c-4048-b894-852c8f5660e1\") " pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.643545 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.643507 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:43.812335 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:43.812300 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-774995c767-jwwmx"] Jul 16 12:40:44.425689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:44.425646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"bb460d74d8294cf55c5e9a422e37efe8217c357e5a1371bc2db9447d9dfcb15d"} Jul 16 12:40:45.433387 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.433348 2567 generic.go:356] "Generic (PLEG): container finished" podID="2983b61d-dc0b-466e-b243-d2a87c233185" containerID="dbf58967729b6e4ef4f51dffc00ce7125466757407f0177e5c86e523a2514fbc" exitCode=0 Jul 16 12:40:45.433885 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.433454 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knsk6" event={"ID":"2983b61d-dc0b-466e-b243-d2a87c233185","Type":"ContainerDied","Data":"dbf58967729b6e4ef4f51dffc00ce7125466757407f0177e5c86e523a2514fbc"} Jul 16 12:40:45.437577 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.437541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" event={"ID":"5c4fe875-c772-4d8c-811b-24c0f704507f","Type":"ContainerStarted","Data":"16d15eb6ce8b8e14d5a8b515f45fc2856eba196250bd81b2fb71233c1b9b8e32"} Jul 16 12:40:45.482369 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.482292 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-phmpm" podStartSLOduration=2.578414962 podStartE2EDuration="4.482266367s" totalImagesPullingTime="1.903851405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:45.481921578 +0000 UTC m=+87.143581687" watchObservedRunningTime="2026-07-16 12:40:45.482266367 +0000 UTC m=+87.143926453" Jul 16 12:40:45.632800 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.632763 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d5b65687b-wl5dd"] Jul 16 12:40:45.635416 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.635393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.638161 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.637769 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-59mo65fijn4sa\"" Jul 16 12:40:45.638161 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.637985 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 12:40:45.638161 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.638000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-slgkw\"" Jul 16 12:40:45.638161 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.637989 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 12:40:45.638161 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.638064 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 12:40:45.638161 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.638101 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 12:40:45.644675 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.644575 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d5b65687b-wl5dd"] Jul 16 12:40:45.687351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/153ca75e-6f99-40d0-96b6-06fe95e372d8-audit-log\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.687351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-secret-metrics-server-tls\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.687351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-client-ca-bundle\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.687665 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-secret-metrics-server-client-certs\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.687665 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8nd2\" (UniqueName: \"kubernetes.io/projected/153ca75e-6f99-40d0-96b6-06fe95e372d8-kube-api-access-h8nd2\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.687665 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153ca75e-6f99-40d0-96b6-06fe95e372d8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.687665 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.687520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/153ca75e-6f99-40d0-96b6-06fe95e372d8-metrics-server-audit-profiles\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788425 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788369 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/153ca75e-6f99-40d0-96b6-06fe95e372d8-metrics-server-audit-profiles\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788605 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/153ca75e-6f99-40d0-96b6-06fe95e372d8-audit-log\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788605 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-secret-metrics-server-tls\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788605 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-client-ca-bundle\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788605 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-secret-metrics-server-client-certs\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788605 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8nd2\" (UniqueName: \"kubernetes.io/projected/153ca75e-6f99-40d0-96b6-06fe95e372d8-kube-api-access-h8nd2\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.788856 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.788633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153ca75e-6f99-40d0-96b6-06fe95e372d8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.789635 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.789583 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153ca75e-6f99-40d0-96b6-06fe95e372d8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.789811 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.789785 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/153ca75e-6f99-40d0-96b6-06fe95e372d8-audit-log\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.790021 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.789978 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/153ca75e-6f99-40d0-96b6-06fe95e372d8-metrics-server-audit-profiles\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.791992 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.791924 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-secret-metrics-server-tls\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.792466 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.792422 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-secret-metrics-server-client-certs\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.793204 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.793143 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153ca75e-6f99-40d0-96b6-06fe95e372d8-client-ca-bundle\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.797442 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.797397 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8nd2\" (UniqueName: \"kubernetes.io/projected/153ca75e-6f99-40d0-96b6-06fe95e372d8-kube-api-access-h8nd2\") pod \"metrics-server-7d5b65687b-wl5dd\" (UID: \"153ca75e-6f99-40d0-96b6-06fe95e372d8\") " pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:45.948925 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:45.948597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:40:46.013669 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.013634 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2"] Jul 16 12:40:46.016325 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.016296 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.019082 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.018984 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rcjqr\"" Jul 16 12:40:46.019224 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.019212 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 12:40:46.024810 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.024786 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2"] Jul 16 12:40:46.091267 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.091223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5715ddb-f521-45dc-9cee-cb19fe6ff4d4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ldwb2\" (UID: \"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.091471 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.091286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft9pw\" (UniqueName: \"kubernetes.io/projected/a5715ddb-f521-45dc-9cee-cb19fe6ff4d4-kube-api-access-ft9pw\") pod \"monitoring-plugin-5f68df7f58-ldwb2\" (UID: \"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.191977 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.191940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9pw\" (UniqueName: \"kubernetes.io/projected/a5715ddb-f521-45dc-9cee-cb19fe6ff4d4-kube-api-access-ft9pw\") pod \"monitoring-plugin-5f68df7f58-ldwb2\" (UID: \"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.192164 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.192066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5715ddb-f521-45dc-9cee-cb19fe6ff4d4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ldwb2\" (UID: \"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.204632 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.200161 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5715ddb-f521-45dc-9cee-cb19fe6ff4d4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-ldwb2\" (UID: \"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.204632 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.200779 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft9pw\" (UniqueName: \"kubernetes.io/projected/a5715ddb-f521-45dc-9cee-cb19fe6ff4d4-kube-api-access-ft9pw\") pod \"monitoring-plugin-5f68df7f58-ldwb2\" (UID: \"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.329863 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.329819 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:46.423285 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.423252 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx"] Jul 16 12:40:46.428101 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.428073 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.430659 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.430626 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 12:40:46.431351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.431039 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v8p4f\"" Jul 16 12:40:46.431351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.431141 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 12:40:46.431351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.431271 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 12:40:46.431571 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.431465 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 12:40:46.431571 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.431535 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 12:40:46.436920 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.436892 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 12:40:46.441969 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.441500 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx"] Jul 16 12:40:46.494557 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-serving-certs-ca-bundle\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.494557 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.494557 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.494858 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-telemeter-client-tls\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.494858 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-federate-client-tls\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.494858 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9p6w\" (UniqueName: \"kubernetes.io/projected/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-kube-api-access-v9p6w\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.494858 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-metrics-client-ca\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.495026 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.494897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-secret-telemeter-client\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-secret-telemeter-client\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595626 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-serving-certs-ca-bundle\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595648 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-telemeter-client-tls\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-federate-client-tls\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9p6w\" (UniqueName: \"kubernetes.io/projected/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-kube-api-access-v9p6w\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.595933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-metrics-client-ca\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.596627 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.596609 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-metrics-client-ca\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.597507 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.597230 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-serving-certs-ca-bundle\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.598103 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.598061 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.598891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.598867 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-secret-telemeter-client\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.598990 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.598898 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-federate-client-tls\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.599110 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.599086 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-telemeter-client-tls\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.599693 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.599664 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.605019 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.604976 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9p6w\" (UniqueName: \"kubernetes.io/projected/ea6f5d1c-4763-4f34-8cb2-c5010b4953ef-kube-api-access-v9p6w\") pod \"telemeter-client-67b9f6bd4-ctnrx\" (UID: \"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef\") " pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:46.740843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:46.740665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" Jul 16 12:40:47.470145 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.470110 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:40:47.483326 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.483293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.485879 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.485644 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 12:40:47.485879 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.485777 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-be86sm9g463b4\"" Jul 16 12:40:47.485879 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.485787 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 12:40:47.486210 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.486099 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 12:40:47.486210 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.486117 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 12:40:47.486210 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.486190 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sgzr4\"" Jul 16 12:40:47.486847 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.486829 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 12:40:47.486953 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.486860 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 12:40:47.487050 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.487022 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 12:40:47.487194 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.487173 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 12:40:47.487321 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.487300 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 12:40:47.487401 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.487333 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 12:40:47.487456 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.487437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 12:40:47.487506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.487479 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 12:40:47.498552 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.498525 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 12:40:47.501799 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.501773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:40:47.504007 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.503983 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 12:40:47.605296 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605254 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605350 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605616 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605616 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605616 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605568 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605783 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605783 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605783 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605783 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605952 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605952 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605952 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.605952 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsv75\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-kube-api-access-xsv75\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.606131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.606131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.605996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.606131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.606030 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.606131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.606066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.606131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.606097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707096 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsv75\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-kube-api-access-xsv75\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.707599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.708158 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.708158 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.708158 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.707673 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.709407 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.708307 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.709407 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.708681 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.709407 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.708855 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.709660 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.709459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.711170 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.710605 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.711170 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.710838 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.711170 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.711064 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.711170 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.711165 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.712017 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.711988 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.712166 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.712146 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.713720 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.713694 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.714310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.714157 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.714310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.714264 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.715056 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.714632 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.715056 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.714953 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.715056 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.715017 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.715820 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.715770 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.717041 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.717016 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.719676 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.719635 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsv75\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-kube-api-access-xsv75\") pod \"prometheus-k8s-0\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:47.803164 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:47.802936 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:40:48.486389 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:48.484325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knsk6" event={"ID":"2983b61d-dc0b-466e-b243-d2a87c233185","Type":"ContainerStarted","Data":"5340bc16aa81890425a3c42552aac0a0d17e5939d247309db0484ecb26e8f76f"} Jul 16 12:40:48.528030 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:48.524564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d5b65687b-wl5dd"] Jul 16 12:40:48.566310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:48.566270 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2"] Jul 16 12:40:48.575882 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:48.575788 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153ca75e_6f99_40d0_96b6_06fe95e372d8.slice/crio-e72c2e26ee1dc6799be83c9bd529a3dc40f0da82b98c12e99c0d16d59fc45728 WatchSource:0}: Error finding container e72c2e26ee1dc6799be83c9bd529a3dc40f0da82b98c12e99c0d16d59fc45728: Status 404 returned error can't find the container with id e72c2e26ee1dc6799be83c9bd529a3dc40f0da82b98c12e99c0d16d59fc45728 Jul 16 12:40:48.576160 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:48.576130 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5715ddb_f521_45dc_9cee_cb19fe6ff4d4.slice/crio-d2102d93688deb33514de76dec01ace9327fa8f6d2b4b771776ed347c70b7e59 WatchSource:0}: Error finding container d2102d93688deb33514de76dec01ace9327fa8f6d2b4b771776ed347c70b7e59: Status 404 returned error can't find the container with id d2102d93688deb33514de76dec01ace9327fa8f6d2b4b771776ed347c70b7e59 Jul 16 12:40:48.794615 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:48.794590 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx"] Jul 16 12:40:48.797876 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:48.797836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6f5d1c_4763_4f34_8cb2_c5010b4953ef.slice/crio-bd6911eb093a9e7ded78f29c3ca4c395b4396b21bbef305f76bd7217c0e3a8f2 WatchSource:0}: Error finding container bd6911eb093a9e7ded78f29c3ca4c395b4396b21bbef305f76bd7217c0e3a8f2: Status 404 returned error can't find the container with id bd6911eb093a9e7ded78f29c3ca4c395b4396b21bbef305f76bd7217c0e3a8f2 Jul 16 12:40:48.799730 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:48.799703 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:40:48.804012 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:40:48.803985 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6766a1_ac92_4a68_97fc_8c334bfe4bb7.slice/crio-aaae95bea01e7d805f3a72c1739bb2434e9ce3cc3a58cd1d1f5750e67f870479 WatchSource:0}: Error finding container aaae95bea01e7d805f3a72c1739bb2434e9ce3cc3a58cd1d1f5750e67f870479: Status 404 returned error can't find the container with id aaae95bea01e7d805f3a72c1739bb2434e9ce3cc3a58cd1d1f5750e67f870479 Jul 16 12:40:49.492916 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.492819 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" event={"ID":"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef","Type":"ContainerStarted","Data":"bd6911eb093a9e7ded78f29c3ca4c395b4396b21bbef305f76bd7217c0e3a8f2"} Jul 16 12:40:49.495473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.495374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" event={"ID":"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4","Type":"ContainerStarted","Data":"d2102d93688deb33514de76dec01ace9327fa8f6d2b4b771776ed347c70b7e59"} Jul 16 12:40:49.501142 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.501115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-knsk6" event={"ID":"2983b61d-dc0b-466e-b243-d2a87c233185","Type":"ContainerStarted","Data":"a95f14fcf4eaf3c7bd0b774486f93042ee77aa3abbeb46a074b792187ab8afa7"} Jul 16 12:40:49.507383 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.507353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw7c4" event={"ID":"9639b256-b79b-4e6f-9e33-41d9249cf939","Type":"ContainerStarted","Data":"3da7dbcc05e316875a585548b9f9b04c351e1543c84e3091669aef2c55c8666f"} Jul 16 12:40:49.509488 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.509459 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff" exitCode=0 Jul 16 12:40:49.509605 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.509568 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff"} Jul 16 12:40:49.513317 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.512656 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" exitCode=0 Jul 16 12:40:49.513317 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.512757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} Jul 16 12:40:49.513317 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.512825 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"aaae95bea01e7d805f3a72c1739bb2434e9ce3cc3a58cd1d1f5750e67f870479"} Jul 16 12:40:49.515084 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.515036 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" event={"ID":"153ca75e-6f99-40d0-96b6-06fe95e372d8","Type":"ContainerStarted","Data":"e72c2e26ee1dc6799be83c9bd529a3dc40f0da82b98c12e99c0d16d59fc45728"} Jul 16 12:40:49.519492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.519463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"58087786c886184856e91e678397615ffc52c58e859328fd014121a90f3224d3"} Jul 16 12:40:49.519596 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.519528 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"b74a1e70f0da9aae11b89fef55cdb108772e4d82d5bc0e655f7759e4864643e2"} Jul 16 12:40:49.519596 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.519554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"dae31301e396c5df054543906285788dc949af3abd90bfba46a4e8a84eca0b45"} Jul 16 12:40:49.526646 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.525366 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-knsk6" podStartSLOduration=6.213323256 podStartE2EDuration="8.525346592s" totalImagesPullingTime="2.200476939s" totalInitContainerRuntime="111.546397ms" isStatefulPod=true podCreationTimestamp="2026-07-16 12:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:49.523950237 +0000 UTC m=+91.185610332" watchObservedRunningTime="2026-07-16 12:40:49.525346592 +0000 UTC m=+91.187006677" Jul 16 12:40:49.568082 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:49.568024 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bw7c4" podStartSLOduration=34.415765791 podStartE2EDuration="50.568000901s" totalImagesPullingTime="16.15223511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:39:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:49.567075013 +0000 UTC m=+91.228735096" watchObservedRunningTime="2026-07-16 12:40:49.568000901 +0000 UTC m=+91.229660987" Jul 16 12:40:50.532532 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:50.532347 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"6fefd203e2c1f79baf4f153b7e11c78f37d64b8309ad5dc0c1f289610349f470"} Jul 16 12:40:50.532532 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:50.532435 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"86e1553a6b372295ae6bc7b1340df13acce16fd99b202418e44687c8897d2c80"} Jul 16 12:40:50.532532 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:50.532480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" event={"ID":"de610a16-a14c-4048-b894-852c8f5660e1","Type":"ContainerStarted","Data":"fb1196d1d5c848968e5a051b24e3c6352e61d762f55496cdab48b7f415f377f3"} Jul 16 12:40:50.533139 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:50.532670 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:50.559801 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:50.559050 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" podStartSLOduration=2.309003622 podStartE2EDuration="7.55902682s" totalImagesPullingTime="5.250023198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:50.556303792 +0000 UTC m=+92.217963876" watchObservedRunningTime="2026-07-16 12:40:50.55902682 +0000 UTC m=+92.220686904" Jul 16 12:40:51.539458 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:51.539418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" event={"ID":"a5715ddb-f521-45dc-9cee-cb19fe6ff4d4","Type":"ContainerStarted","Data":"28beea4eb94aa5d52bfe43d65d6f460481fc3cba97e4bf62671bf440e3db4c64"} Jul 16 12:40:51.540040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:51.539790 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:51.544771 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:51.544702 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" event={"ID":"153ca75e-6f99-40d0-96b6-06fe95e372d8","Type":"ContainerStarted","Data":"8c2f12177407d88bcca2d06ebdbf7768d1ea9fe444a3e0dec98b926e72819be4"} Jul 16 12:40:51.546026 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:51.545975 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" Jul 16 12:40:51.557153 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:51.557092 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-ldwb2" podStartSLOduration=4.395560193 podStartE2EDuration="6.557072849s" totalImagesPullingTime="2.161512656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:51.556027256 +0000 UTC m=+93.217687366" watchObservedRunningTime="2026-07-16 12:40:51.557072849 +0000 UTC m=+93.218732926" Jul 16 12:40:51.575407 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:51.575348 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" podStartSLOduration=4.418021641 podStartE2EDuration="6.575327705s" totalImagesPullingTime="2.157306064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:51.573252138 +0000 UTC m=+93.234912228" watchObservedRunningTime="2026-07-16 12:40:51.575327705 +0000 UTC m=+93.236987788" Jul 16 12:40:55.544560 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:55.544493 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" podUID="01fe3bcf-8be0-4057-8419-7052129956a9" containerName="registry" containerID="cri-o://64c5153c606afdc99a8add3638a13b950be2c6ef0340c2862de969803d9d0d6d" gracePeriod=30 Jul 16 12:40:56.551699 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:56.551667 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-774995c767-jwwmx" Jul 16 12:40:59.582042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:59.581965 2567 generic.go:356] "Generic (PLEG): container finished" podID="01fe3bcf-8be0-4057-8419-7052129956a9" containerID="64c5153c606afdc99a8add3638a13b950be2c6ef0340c2862de969803d9d0d6d" exitCode=0 Jul 16 12:40:59.582490 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:40:59.582044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" event={"ID":"01fe3bcf-8be0-4057-8419-7052129956a9","Type":"ContainerDied","Data":"64c5153c606afdc99a8add3638a13b950be2c6ef0340c2862de969803d9d0d6d"} Jul 16 12:41:00.524051 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:00.524014 2567 patch_prober.go:28] interesting pod/image-registry-768bc59f49-8t49s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.134.0.10:5000/healthz\": dial tcp 10.134.0.10:5000: connect: connection refused" start-of-body= Jul 16 12:41:00.524226 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:00.524086 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" podUID="01fe3bcf-8be0-4057-8419-7052129956a9" containerName="registry" probeResult="failure" output="Get \"https://10.134.0.10:5000/healthz\": dial tcp 10.134.0.10:5000: connect: connection refused" Jul 16 12:41:01.357331 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.357300 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-svkwm" Jul 16 12:41:01.441535 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.441514 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:41:01.548920 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.548895 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-bound-sa-token\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549058 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.548944 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549058 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.548985 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01fe3bcf-8be0-4057-8419-7052129956a9-ca-trust-extracted\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549058 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549032 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-registry-certificates\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549058 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549056 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-image-registry-private-configuration\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549267 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549090 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdxth\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-kube-api-access-jdxth\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549267 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-trusted-ca\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.549719 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549554 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:41:01.549842 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549706 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:41:01.549842 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.549791 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-installation-pull-secrets\") pod \"01fe3bcf-8be0-4057-8419-7052129956a9\" (UID: \"01fe3bcf-8be0-4057-8419-7052129956a9\") " Jul 16 12:41:01.550297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.550181 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-registry-certificates\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.550297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.550207 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01fe3bcf-8be0-4057-8419-7052129956a9-trusted-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.551632 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.551609 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:41:01.551784 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.551753 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:41:01.551845 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.551730 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:41:01.551883 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.551834 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-kube-api-access-jdxth" (OuterVolumeSpecName: "kube-api-access-jdxth") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "kube-api-access-jdxth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:41:01.552219 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.552199 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:41:01.558087 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.558061 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01fe3bcf-8be0-4057-8419-7052129956a9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "01fe3bcf-8be0-4057-8419-7052129956a9" (UID: "01fe3bcf-8be0-4057-8419-7052129956a9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:41:01.591544 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.591523 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" Jul 16 12:41:01.591544 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.591533 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bc59f49-8t49s" event={"ID":"01fe3bcf-8be0-4057-8419-7052129956a9","Type":"ContainerDied","Data":"86e86b5ad3c36acc170b58cc4cd6aaa6c3eefa10d61bf5b7765829822de7a178"} Jul 16 12:41:01.591667 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.591587 2567 scope.go:117] "RemoveContainer" containerID="64c5153c606afdc99a8add3638a13b950be2c6ef0340c2862de969803d9d0d6d" Jul 16 12:41:01.612685 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.612659 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768bc59f49-8t49s"] Jul 16 12:41:01.617269 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.617243 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-768bc59f49-8t49s"] Jul 16 12:41:01.650710 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.650687 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01fe3bcf-8be0-4057-8419-7052129956a9-ca-trust-extracted\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.650710 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.650709 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-image-registry-private-configuration\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.650864 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.650721 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdxth\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-kube-api-access-jdxth\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.650864 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.650730 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01fe3bcf-8be0-4057-8419-7052129956a9-installation-pull-secrets\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.650864 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.650757 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-bound-sa-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:01.650864 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:01.650765 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01fe3bcf-8be0-4057-8419-7052129956a9-registry-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:41:02.601617 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.600777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" event={"ID":"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef","Type":"ContainerStarted","Data":"86de52181da1440440de86889fc94aed3251789d4547c23b91d28c9c9e5ab020"} Jul 16 12:41:02.601617 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.600881 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" event={"ID":"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef","Type":"ContainerStarted","Data":"8adbc6a4f99033e447aec2e96642e418de005bfcc0b8b3cabb1d5b27306432a5"} Jul 16 12:41:02.601617 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.600908 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" event={"ID":"ea6f5d1c-4763-4f34-8cb2-c5010b4953ef","Type":"ContainerStarted","Data":"85eacd098d7f598259a3e2a014ca6553a4966f1dde080d9f0365aa54ad2a71dd"} Jul 16 12:41:02.605117 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.605083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249"} Jul 16 12:41:02.605248 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.605159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d"} Jul 16 12:41:02.605248 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.605208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481"} Jul 16 12:41:02.605368 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.605249 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197"} Jul 16 12:41:02.605368 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.605285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2"} Jul 16 12:41:02.605368 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.605323 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerStarted","Data":"be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d"} Jul 16 12:41:02.611191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.610294 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} Jul 16 12:41:02.611191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.610376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} Jul 16 12:41:02.611191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.610429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} Jul 16 12:41:02.611191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.610467 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} Jul 16 12:41:02.611191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.610506 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} Jul 16 12:41:02.611191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.610547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerStarted","Data":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} Jul 16 12:41:02.611950 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.611925 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-tz9hc" event={"ID":"f548ed0a-c0e4-4e7d-83bb-80a796182f78","Type":"ContainerStarted","Data":"e800edddda4ed6bc224ced411b5e494c911a5b3cfc4f59d5985da4dd11389c65"} Jul 16 12:41:02.612173 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.612151 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:41:02.626522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.626466 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67b9f6bd4-ctnrx" podStartSLOduration=3.930062759 podStartE2EDuration="16.626448545s" totalImagesPullingTime="12.696385786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:41:02.623399209 +0000 UTC m=+104.285059315" watchObservedRunningTime="2026-07-16 12:41:02.626448545 +0000 UTC m=+104.288108629" Jul 16 12:41:02.627237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.627212 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-tz9hc" Jul 16 12:41:02.654138 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.654070 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.715669868 podStartE2EDuration="20.654047759s" totalImagesPullingTime="16.903398375s" totalInitContainerRuntime="34.979516ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:41:02.652007262 +0000 UTC m=+104.313667368" watchObservedRunningTime="2026-07-16 12:41:02.654047759 +0000 UTC m=+104.315707843" Jul 16 12:41:02.671465 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.671399 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-tz9hc" podStartSLOduration=1.757647411 podStartE2EDuration="23.6713794s" totalImagesPullingTime="21.913731989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:41:02.66991705 +0000 UTC m=+104.331577157" watchObservedRunningTime="2026-07-16 12:41:02.6713794 +0000 UTC m=+104.333039484" Jul 16 12:41:02.723908 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.723841 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.709654871 podStartE2EDuration="15.723814738s" totalImagesPullingTime="11.989125877s" totalInitContainerRuntime="25.03399ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:41:02.702763494 +0000 UTC m=+104.364423596" watchObservedRunningTime="2026-07-16 12:41:02.723814738 +0000 UTC m=+104.385474821" Jul 16 12:41:02.803916 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.803864 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:41:02.978271 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:02.978182 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fe3bcf-8be0-4057-8419-7052129956a9" path="/var/lib/kubelet/pods/01fe3bcf-8be0-4057-8419-7052129956a9/volumes" Jul 16 12:41:05.949176 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:05.949143 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:41:05.949748 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:05.949247 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:41:25.956467 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:25.956414 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:41:25.966101 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:25.966076 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d5b65687b-wl5dd" Jul 16 12:41:47.803095 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:47.803062 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:41:47.866674 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:47.866641 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:41:47.882302 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:41:47.882275 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:01.600262 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600224 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:42:01.600850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600518 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="alertmanager" containerID="cri-o://be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d" gracePeriod=120 Jul 16 12:42:01.600850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600608 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="prom-label-proxy" containerID="cri-o://f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249" gracePeriod=120 Jul 16 12:42:01.600850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600640 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="config-reloader" containerID="cri-o://47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2" gracePeriod=120 Jul 16 12:42:01.600850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600643 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-web" containerID="cri-o://1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197" gracePeriod=120 Jul 16 12:42:01.600850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600660 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy" containerID="cri-o://e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481" gracePeriod=120 Jul 16 12:42:01.600850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.600591 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-metric" containerID="cri-o://46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d" gracePeriod=120 Jul 16 12:42:01.869965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.869878 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249" exitCode=0 Jul 16 12:42:01.869965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.869910 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d" exitCode=0 Jul 16 12:42:01.869965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.869917 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481" exitCode=0 Jul 16 12:42:01.869965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.869922 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2" exitCode=0 Jul 16 12:42:01.869965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.869928 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d" exitCode=0 Jul 16 12:42:01.869965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.869947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249"} Jul 16 12:42:01.870266 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.870038 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d"} Jul 16 12:42:01.870266 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.870067 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481"} Jul 16 12:42:01.870266 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.870092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2"} Jul 16 12:42:01.870266 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:01.870116 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d"} Jul 16 12:42:02.859946 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.859923 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:02.878350 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.878317 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f379583-9bff-4064-a1a0-fec12366e777" containerID="1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197" exitCode=0 Jul 16 12:42:02.878522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.878375 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197"} Jul 16 12:42:02.878522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.878434 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:02.878522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.878448 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f379583-9bff-4064-a1a0-fec12366e777","Type":"ContainerDied","Data":"08a90fec9916ae094bfa4788e95673606b92396c1f554502a86877e314ba9ed7"} Jul 16 12:42:02.878522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.878487 2567 scope.go:117] "RemoveContainer" containerID="f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249" Jul 16 12:42:02.883678 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883653 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-web-config\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.883832 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883693 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.883832 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883723 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-config-volume\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.883832 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883774 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-main-db\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.883832 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883792 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-tls-assets\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.883832 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883816 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-cluster-tls-config\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883847 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-config-out\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883879 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883915 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-web\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883941 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr84p\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-kube-api-access-pr84p\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.883974 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.884003 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884099 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.884039 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-metrics-client-ca\") pod \"4f379583-9bff-4064-a1a0-fec12366e777\" (UID: \"4f379583-9bff-4064-a1a0-fec12366e777\") " Jul 16 12:42:02.884453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.884135 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:42:02.884453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.884425 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-main-db\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.884561 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.884487 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:02.885128 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.885094 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:02.887144 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.887114 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.887259 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.887239 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.887624 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.887597 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-config-volume" (OuterVolumeSpecName: "config-volume") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.887856 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.887793 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.887917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.887852 2567 scope.go:117] "RemoveContainer" containerID="46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d" Jul 16 12:42:02.887917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.887867 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:42:02.888819 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.888793 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-kube-api-access-pr84p" (OuterVolumeSpecName: "kube-api-access-pr84p") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "kube-api-access-pr84p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:42:02.888908 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.888838 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-config-out" (OuterVolumeSpecName: "config-out") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:42:02.888908 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.888843 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.893537 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.893505 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.903261 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.903232 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-web-config" (OuterVolumeSpecName: "web-config") pod "4f379583-9bff-4064-a1a0-fec12366e777" (UID: "4f379583-9bff-4064-a1a0-fec12366e777"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:02.910947 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.910922 2567 scope.go:117] "RemoveContainer" containerID="e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481" Jul 16 12:42:02.920011 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.919992 2567 scope.go:117] "RemoveContainer" containerID="1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197" Jul 16 12:42:02.927521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.927502 2567 scope.go:117] "RemoveContainer" containerID="47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2" Jul 16 12:42:02.936441 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.936415 2567 scope.go:117] "RemoveContainer" containerID="be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d" Jul 16 12:42:02.943980 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.943962 2567 scope.go:117] "RemoveContainer" containerID="7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff" Jul 16 12:42:02.952615 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.952594 2567 scope.go:117] "RemoveContainer" containerID="f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249" Jul 16 12:42:02.952993 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.952972 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249\": container with ID starting with f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249 not found: ID does not exist" containerID="f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249" Jul 16 12:42:02.953050 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953002 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249"} err="failed to get container status \"f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249\": rpc error: code = NotFound desc = could not find container \"f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249\": container with ID starting with f647b6c9f7757d31b1687155fa24dd4cf7dade36dbbff981b1e1da723bee6249 not found: ID does not exist" Jul 16 12:42:02.953050 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953039 2567 scope.go:117] "RemoveContainer" containerID="46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d" Jul 16 12:42:02.953314 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.953294 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d\": container with ID starting with 46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d not found: ID does not exist" containerID="46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d" Jul 16 12:42:02.953387 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953323 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d"} err="failed to get container status \"46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d\": rpc error: code = NotFound desc = could not find container \"46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d\": container with ID starting with 46967a02b4e6683dd2cb7309f0275328ff49e9980398731915ca038b27411c0d not found: ID does not exist" Jul 16 12:42:02.953387 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953345 2567 scope.go:117] "RemoveContainer" containerID="e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481" Jul 16 12:42:02.953618 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.953601 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481\": container with ID starting with e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481 not found: ID does not exist" containerID="e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481" Jul 16 12:42:02.953689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953624 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481"} err="failed to get container status \"e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481\": rpc error: code = NotFound desc = could not find container \"e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481\": container with ID starting with e8b5b1f3ea1e6a059f2f126840d15634f1f0af433b2ed0001778d7eb9d3cf481 not found: ID does not exist" Jul 16 12:42:02.953689 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953644 2567 scope.go:117] "RemoveContainer" containerID="1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197" Jul 16 12:42:02.953904 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.953886 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197\": container with ID starting with 1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197 not found: ID does not exist" containerID="1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197" Jul 16 12:42:02.953967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953912 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197"} err="failed to get container status \"1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197\": rpc error: code = NotFound desc = could not find container \"1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197\": container with ID starting with 1408d2a8436bb4f76fee6c05533276a242c8cc2a450e530866b32b6d46f51197 not found: ID does not exist" Jul 16 12:42:02.953967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.953933 2567 scope.go:117] "RemoveContainer" containerID="47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2" Jul 16 12:42:02.954229 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.954213 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2\": container with ID starting with 47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2 not found: ID does not exist" containerID="47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2" Jul 16 12:42:02.954297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.954237 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2"} err="failed to get container status \"47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2\": rpc error: code = NotFound desc = could not find container \"47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2\": container with ID starting with 47134bb98717df84fa86ce732a3248f535b7c64804b06c5a1d2dbb70291c6bb2 not found: ID does not exist" Jul 16 12:42:02.954297 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.954257 2567 scope.go:117] "RemoveContainer" containerID="be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d" Jul 16 12:42:02.954483 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.954467 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d\": container with ID starting with be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d not found: ID does not exist" containerID="be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d" Jul 16 12:42:02.954546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.954489 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d"} err="failed to get container status \"be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d\": rpc error: code = NotFound desc = could not find container \"be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d\": container with ID starting with be0d668b1306817eb203df556fb05ceb84977b326022ea6d700f0c9d8e42428d not found: ID does not exist" Jul 16 12:42:02.954546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.954509 2567 scope.go:117] "RemoveContainer" containerID="7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff" Jul 16 12:42:02.954724 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:02.954710 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff\": container with ID starting with 7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff not found: ID does not exist" containerID="7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff" Jul 16 12:42:02.954804 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.954747 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff"} err="failed to get container status \"7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff\": rpc error: code = NotFound desc = could not find container \"7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff\": container with ID starting with 7fa7f5663e60a8bc4551196098cb77334bcd3b519a2f57780180db6893809aff not found: ID does not exist" Jul 16 12:42:02.985789 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985765 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-web-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985789 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985789 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-main-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985798 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-config-volume\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985807 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-tls-assets\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985814 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-cluster-tls-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985822 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f379583-9bff-4064-a1a0-fec12366e777-config-out\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985833 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985843 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985852 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr84p\" (UniqueName: \"kubernetes.io/projected/4f379583-9bff-4064-a1a0-fec12366e777-kube-api-access-pr84p\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985861 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f379583-9bff-4064-a1a0-fec12366e777-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985871 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:02.985917 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:02.985879 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f379583-9bff-4064-a1a0-fec12366e777-metrics-client-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:03.196546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.196470 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:42:03.201471 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.201445 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:42:03.225500 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225460 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:42:03.225798 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225785 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="init-config-reloader" Jul 16 12:42:03.225839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225800 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="init-config-reloader" Jul 16 12:42:03.225839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225814 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="alertmanager" Jul 16 12:42:03.225839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225820 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="alertmanager" Jul 16 12:42:03.225839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225829 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-web" Jul 16 12:42:03.225839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225835 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-web" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225845 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-metric" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225851 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-metric" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225859 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe3bcf-8be0-4057-8419-7052129956a9" containerName="registry" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225864 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe3bcf-8be0-4057-8419-7052129956a9" containerName="registry" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225871 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="prom-label-proxy" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225876 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="prom-label-proxy" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225882 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225887 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225893 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="config-reloader" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225898 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="config-reloader" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225952 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="config-reloader" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225963 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="prom-label-proxy" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225971 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225976 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="alertmanager" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225981 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-web" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225987 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fe3bcf-8be0-4057-8419-7052129956a9" containerName="registry" Jul 16 12:42:03.225986 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.225993 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f379583-9bff-4064-a1a0-fec12366e777" containerName="kube-rbac-proxy-metric" Jul 16 12:42:03.229617 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.229599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.232103 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232079 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 12:42:03.232245 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232113 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 12:42:03.232245 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232204 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 12:42:03.232245 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232218 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 12:42:03.232401 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232262 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 12:42:03.232546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232530 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 12:42:03.232690 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232676 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8hkpz\"" Jul 16 12:42:03.232780 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232763 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 12:42:03.232839 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.232793 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 12:42:03.237873 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.237728 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 12:42:03.246286 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.246265 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:42:03.288546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07c66b3f-527a-4323-8976-223997fceda9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288701 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07c66b3f-527a-4323-8976-223997fceda9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288701 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c66b3f-527a-4323-8976-223997fceda9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288701 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-web-config\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288701 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwwzf\" (UniqueName: \"kubernetes.io/projected/07c66b3f-527a-4323-8976-223997fceda9-kube-api-access-wwwzf\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288701 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-config-volume\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c66b3f-527a-4323-8976-223997fceda9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288779 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.288891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.289033 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.289033 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.288915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07c66b3f-527a-4323-8976-223997fceda9-config-out\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390155 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07c66b3f-527a-4323-8976-223997fceda9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390319 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07c66b3f-527a-4323-8976-223997fceda9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390319 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c66b3f-527a-4323-8976-223997fceda9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390319 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390260 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-web-config\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390441 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwwzf\" (UniqueName: \"kubernetes.io/projected/07c66b3f-527a-4323-8976-223997fceda9-kube-api-access-wwwzf\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390441 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-config-volume\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390539 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c66b3f-527a-4323-8976-223997fceda9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390539 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390626 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07c66b3f-527a-4323-8976-223997fceda9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390835 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390973 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390973 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390973 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.390973 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.390916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07c66b3f-527a-4323-8976-223997fceda9-config-out\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.391510 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.391278 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07c66b3f-527a-4323-8976-223997fceda9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.391510 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.391434 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07c66b3f-527a-4323-8976-223997fceda9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.393371 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.393342 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-web-config\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.393466 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.393387 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-config-volume\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.393466 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.393409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.393466 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.393412 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07c66b3f-527a-4323-8976-223997fceda9-config-out\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.393466 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.393451 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07c66b3f-527a-4323-8976-223997fceda9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.393730 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.393708 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.394054 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.394037 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.394247 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.394225 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.395311 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.395295 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07c66b3f-527a-4323-8976-223997fceda9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.397781 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.397759 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwwzf\" (UniqueName: \"kubernetes.io/projected/07c66b3f-527a-4323-8976-223997fceda9-kube-api-access-wwwzf\") pod \"alertmanager-main-0\" (UID: \"07c66b3f-527a-4323-8976-223997fceda9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.540771 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.540664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 12:42:03.684478 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.684455 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 12:42:03.686632 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:42:03.686592 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c66b3f_527a_4323_8976_223997fceda9.slice/crio-eae5f681cd397e5078af9b06714065d0b3ae13f7f15c65d40a0c105277d03f0d WatchSource:0}: Error finding container eae5f681cd397e5078af9b06714065d0b3ae13f7f15c65d40a0c105277d03f0d: Status 404 returned error can't find the container with id eae5f681cd397e5078af9b06714065d0b3ae13f7f15c65d40a0c105277d03f0d Jul 16 12:42:03.884396 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.884360 2567 generic.go:356] "Generic (PLEG): container finished" podID="07c66b3f-527a-4323-8976-223997fceda9" containerID="4a5d2a75c82b2429ccbc5c616273d3b721547bac165fa6b7ec13e94fe9e869dc" exitCode=0 Jul 16 12:42:03.884803 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.884422 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerDied","Data":"4a5d2a75c82b2429ccbc5c616273d3b721547bac165fa6b7ec13e94fe9e869dc"} Jul 16 12:42:03.884803 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:03.884473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"eae5f681cd397e5078af9b06714065d0b3ae13f7f15c65d40a0c105277d03f0d"} Jul 16 12:42:04.892724 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.892687 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"74a941edbc2cb3f42f4dd3989d774a6f0d1262e1fe81c9949dc9eb7652ff4c77"} Jul 16 12:42:04.893102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.892769 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"b89d73e9a526efeb51a2901f5d56e54e5d6bc6c28521918db19a391a63786e89"} Jul 16 12:42:04.893102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.892797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"47a445449c33cf016335e58279aec37e373003deb88612cdb1c8726bcb81b483"} Jul 16 12:42:04.893102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.892821 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"bf7210097dad89a0964cf04e05d536f686ff1756f7f99e2df4b246937edcb55d"} Jul 16 12:42:04.893102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.892847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"02433291ee238262b913ac6653febd69a742d57946bcc0e5d5a4348e2bb3187d"} Jul 16 12:42:04.893102 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.892874 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07c66b3f-527a-4323-8976-223997fceda9","Type":"ContainerStarted","Data":"0c653539a4ff578438258197fcdc9cfce77446bc07d871311a83fa64e47b22bf"} Jul 16 12:42:04.926418 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.926306 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.910281492 podStartE2EDuration="1.926289473s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.007981ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:42:04.925253294 +0000 UTC m=+166.586913396" watchObservedRunningTime="2026-07-16 12:42:04.926289473 +0000 UTC m=+166.587949556" Jul 16 12:42:04.975883 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:04.975852 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f379583-9bff-4064-a1a0-fec12366e777" path="/var/lib/kubelet/pods/4f379583-9bff-4064-a1a0-fec12366e777/volumes" Jul 16 12:42:05.827965 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.827924 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:42:05.828280 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.828255 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="prometheus" containerID="cri-o://caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" gracePeriod=600 Jul 16 12:42:05.828382 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.828284 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="thanos-sidecar" containerID="cri-o://b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" gracePeriod=600 Jul 16 12:42:05.828382 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.828325 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="config-reloader" containerID="cri-o://bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" gracePeriod=600 Jul 16 12:42:05.828382 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.828317 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" gracePeriod=600 Jul 16 12:42:05.828517 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.828321 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-web" containerID="cri-o://4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" gracePeriod=600 Jul 16 12:42:05.828517 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:05.828284 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy" containerID="cri-o://14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" gracePeriod=600 Jul 16 12:42:06.069726 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.069700 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:06.122849 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.122814 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.122875 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-web-config\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.122906 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-0\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.122962 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-metrics-client-certs\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.122990 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config-out\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123040 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123019 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-kubelet-serving-ca-bundle\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123299 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123047 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsv75\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-kube-api-access-xsv75\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.123299 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123070 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123419 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123485 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-thanos-prometheus-http-client-file\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123532 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123560 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-db\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123587 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-1\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123636 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-2\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123676 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-tls\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123710 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-serving-certs-ca-bundle\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123757 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-metrics-client-ca\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123791 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-tls-assets\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123955 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-kube-rbac-proxy\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.123983 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-trusted-ca-bundle\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.124041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-grpc-tls\") pod \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\" (UID: \"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7\") " Jul 16 12:42:06.124599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.124325 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.125377 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.125186 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.125444 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.125426 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.125844 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.125807 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.126221 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.126154 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.126682 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.126656 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.127030 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.126972 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.127226 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.127197 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.127359 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.127284 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:42:06.127359 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.127293 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config" (OuterVolumeSpecName: "config") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.127470 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.127364 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-kube-api-access-xsv75" (OuterVolumeSpecName: "kube-api-access-xsv75") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "kube-api-access-xsv75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:42:06.127566 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.127540 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config-out" (OuterVolumeSpecName: "config-out") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:42:06.127674 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.127654 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:42:06.128194 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.128168 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.128293 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.128274 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.128693 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.128671 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.129349 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.129322 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:42:06.129428 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.129357 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.129787 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.129762 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.138702 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.138679 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-web-config" (OuterVolumeSpecName: "web-config") pod "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" (UID: "5d6766a1-ac92-4a68-97fc-8c334bfe4bb7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:42:06.225238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225194 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-web-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225231 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225241 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-metrics-client-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225251 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config-out\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225260 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsv75\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-kube-api-access-xsv75\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225270 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225279 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225289 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225298 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-db\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225308 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225319 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225328 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225337 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225346 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-configmap-metrics-client-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225354 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-tls-assets\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225362 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-kube-rbac-proxy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225370 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225380 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-grpc-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.225496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.225389 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:42:06.909505 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909471 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" exitCode=0 Jul 16 12:42:06.909505 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909500 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" exitCode=0 Jul 16 12:42:06.909505 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909506 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" exitCode=0 Jul 16 12:42:06.909505 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909514 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" exitCode=0 Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909520 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" exitCode=0 Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909526 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" exitCode=0 Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909545 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909648 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909676 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909703 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909716 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.909778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909727 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} Jul 16 12:42:06.910236 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} Jul 16 12:42:06.910236 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.909812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d6766a1-ac92-4a68-97fc-8c334bfe4bb7","Type":"ContainerDied","Data":"aaae95bea01e7d805f3a72c1739bb2434e9ce3cc3a58cd1d1f5750e67f870479"} Jul 16 12:42:06.919781 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.919724 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.926959 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.926942 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.933902 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.933879 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.936964 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.936942 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:42:06.940335 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.940309 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:42:06.941773 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.941757 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.948488 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.948468 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.955804 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.955786 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.963242 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.963222 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.963573 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.963530 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.963664 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.963584 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} err="failed to get container status \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" Jul 16 12:42:06.963664 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.963607 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.963908 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.963883 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.963976 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.963918 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} err="failed to get container status \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" Jul 16 12:42:06.963976 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.963941 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.964213 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.964197 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.964275 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964216 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} err="failed to get container status \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" Jul 16 12:42:06.964275 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964230 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.964507 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.964490 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.964563 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964513 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} err="failed to get container status \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" Jul 16 12:42:06.964563 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964531 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.964671 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964652 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:42:06.964777 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.964757 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.964833 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964783 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} err="failed to get container status \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" Jul 16 12:42:06.964833 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.964800 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.965061 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.965046 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.965120 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965064 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} err="failed to get container status \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" Jul 16 12:42:06.965120 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965077 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965124 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-thanos" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965143 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-thanos" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965157 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="init-config-reloader" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965166 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="init-config-reloader" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965190 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965199 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965211 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-web" Jul 16 12:42:06.965220 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965220 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-web" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965232 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="prometheus" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965241 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="prometheus" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965251 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="thanos-sidecar" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965260 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="thanos-sidecar" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:42:06.965268 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965283 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} err="failed to get container status \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965303 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965272 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="config-reloader" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965344 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="config-reloader" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965430 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965447 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="thanos-sidecar" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965455 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="prometheus" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965462 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-thanos" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965470 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="config-reloader" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965478 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" containerName="kube-rbac-proxy-web" Jul 16 12:42:06.965521 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965510 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} err="failed to get container status \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" Jul 16 12:42:06.966071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965532 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.966071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965731 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} err="failed to get container status \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" Jul 16 12:42:06.966071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965765 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.966071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965951 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} err="failed to get container status \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" Jul 16 12:42:06.966071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.965973 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.966241 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966198 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} err="failed to get container status \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" Jul 16 12:42:06.966241 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966212 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.966489 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966468 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} err="failed to get container status \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" Jul 16 12:42:06.966489 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966488 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.966699 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966682 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} err="failed to get container status \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" Jul 16 12:42:06.966764 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966700 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.966915 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966900 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} err="failed to get container status \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" Jul 16 12:42:06.966915 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.966914 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.967131 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967112 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} err="failed to get container status \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" Jul 16 12:42:06.967174 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967132 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.967342 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967318 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} err="failed to get container status \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" Jul 16 12:42:06.967387 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967344 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.967546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967526 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} err="failed to get container status \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" Jul 16 12:42:06.967546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967543 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.967797 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967779 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} err="failed to get container status \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" Jul 16 12:42:06.967882 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.967798 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.968028 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968012 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} err="failed to get container status \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" Jul 16 12:42:06.968075 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968029 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.968244 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968225 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} err="failed to get container status \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" Jul 16 12:42:06.968283 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968244 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.968449 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968431 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} err="failed to get container status \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" Jul 16 12:42:06.968503 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968450 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.968653 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968638 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} err="failed to get container status \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" Jul 16 12:42:06.968699 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968653 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.968872 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968855 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} err="failed to get container status \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" Jul 16 12:42:06.968919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.968872 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.969106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969091 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} err="failed to get container status \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" Jul 16 12:42:06.969142 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969106 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.969325 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969309 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} err="failed to get container status \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" Jul 16 12:42:06.969374 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969325 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.969539 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969520 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} err="failed to get container status \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" Jul 16 12:42:06.969583 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969541 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.969682 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969667 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:06.969777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969756 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} err="failed to get container status \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" Jul 16 12:42:06.969840 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.969779 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.970049 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970025 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} err="failed to get container status \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" Jul 16 12:42:06.970126 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970050 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.970405 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970363 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} err="failed to get container status \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" Jul 16 12:42:06.970405 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970391 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.970654 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970635 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} err="failed to get container status \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" Jul 16 12:42:06.970730 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970658 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.970930 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970913 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} err="failed to get container status \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" Jul 16 12:42:06.971009 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.970932 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.971202 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971181 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} err="failed to get container status \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" Jul 16 12:42:06.971268 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971202 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.971443 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971426 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} err="failed to get container status \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" Jul 16 12:42:06.971518 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971444 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.971746 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971712 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} err="failed to get container status \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" Jul 16 12:42:06.971800 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971755 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.971849 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971813 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 12:42:06.972005 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.971987 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 12:42:06.972112 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972016 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} err="failed to get container status \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" Jul 16 12:42:06.972112 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972070 2567 scope.go:117] "RemoveContainer" containerID="c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df" Jul 16 12:42:06.972112 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972024 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 12:42:06.972286 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972050 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-be86sm9g463b4\"" Jul 16 12:42:06.972286 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972225 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 12:42:06.972407 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972388 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 12:42:06.972465 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972392 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df"} err="failed to get container status \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": rpc error: code = NotFound desc = could not find container \"c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df\": container with ID starting with c9c94a91c9ef0b484ac1be0545825be1d4757c0f9c14967e6e56b5cb2ff2b2df not found: ID does not exist" Jul 16 12:42:06.972465 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972426 2567 scope.go:117] "RemoveContainer" containerID="14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4" Jul 16 12:42:06.972572 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972488 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 12:42:06.972626 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972586 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 12:42:06.972626 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972613 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 12:42:06.972626 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 12:42:06.972831 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972808 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sgzr4\"" Jul 16 12:42:06.972905 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972868 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 12:42:06.972967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 12:42:06.972967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972913 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4"} err="failed to get container status \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": rpc error: code = NotFound desc = could not find container \"14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4\": container with ID starting with 14e60aff632e7c640a7eedf5c2cda0a197726c7db2976f085916ab620587edc4 not found: ID does not exist" Jul 16 12:42:06.972967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972934 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 12:42:06.972967 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.972940 2567 scope.go:117] "RemoveContainer" containerID="4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856" Jul 16 12:42:06.973277 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.973254 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856"} err="failed to get container status \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": rpc error: code = NotFound desc = could not find container \"4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856\": container with ID starting with 4b4402d409feb13881ba7566d3c35c90e9b07a7f1a4344faa0ca496648f80856 not found: ID does not exist" Jul 16 12:42:06.973355 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.973280 2567 scope.go:117] "RemoveContainer" containerID="b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d" Jul 16 12:42:06.973591 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.973566 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d"} err="failed to get container status \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": rpc error: code = NotFound desc = could not find container \"b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d\": container with ID starting with b405a84457b60458707862a2d024a38f2077a7dc2d6a844c4080b0e71bfa8d4d not found: ID does not exist" Jul 16 12:42:06.973591 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.973591 2567 scope.go:117] "RemoveContainer" containerID="bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892" Jul 16 12:42:06.974000 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.973892 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892"} err="failed to get container status \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": rpc error: code = NotFound desc = could not find container \"bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892\": container with ID starting with bf91a8ef1cb39018a58eddad8fd63855b8ed105bb575e91371a589e75a0f6892 not found: ID does not exist" Jul 16 12:42:06.974000 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.973917 2567 scope.go:117] "RemoveContainer" containerID="caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571" Jul 16 12:42:06.974337 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.974232 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571"} err="failed to get container status \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": rpc error: code = NotFound desc = could not find container \"caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571\": container with ID starting with caff93fd5342c9d123956ee9cdb986389c66ce814d59bad09071eaae05c65571 not found: ID does not exist" Jul 16 12:42:06.974337 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.974256 2567 scope.go:117] "RemoveContainer" containerID="33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38" Jul 16 12:42:06.974601 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.974574 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38"} err="failed to get container status \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": rpc error: code = NotFound desc = could not find container \"33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38\": container with ID starting with 33ef81b7d37747e98a3af2a18b91eca9598bddee4ac07f342445ed5903064c38 not found: ID does not exist" Jul 16 12:42:06.976105 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.976085 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 12:42:06.977453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.977430 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6766a1-ac92-4a68-97fc-8c334bfe4bb7" path="/var/lib/kubelet/pods/5d6766a1-ac92-4a68-97fc-8c334bfe4bb7/volumes" Jul 16 12:42:06.977987 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.977967 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 12:42:06.986667 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:06.986645 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:42:07.030697 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7678f2d-cc9b-444f-b023-b692f53aecc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030697 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7678f2d-cc9b-444f-b023-b692f53aecc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030802 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmzt2\" (UniqueName: \"kubernetes.io/projected/e7678f2d-cc9b-444f-b023-b692f53aecc0-kube-api-access-rmzt2\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.030935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.031237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.031237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.030983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.031237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.031237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.031237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.031237 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.036168 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-config\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.036168 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.036168 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.036168 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.036168 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.031907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.132789 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.132752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.132803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.132828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.132845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmzt2\" (UniqueName: \"kubernetes.io/projected/e7678f2d-cc9b-444f-b023-b692f53aecc0-kube-api-access-rmzt2\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.132863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.132886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-config\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133497 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7678f2d-cc9b-444f-b023-b692f53aecc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7678f2d-cc9b-444f-b023-b692f53aecc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133664 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133701 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.133881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.133714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.135347 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.134510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.135347 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.135035 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.135500 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.135375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.135961 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.135932 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.136169 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.136142 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.136531 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.136503 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.136859 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.136836 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7678f2d-cc9b-444f-b023-b692f53aecc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.137341 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.137315 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.137473 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.137449 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7678f2d-cc9b-444f-b023-b692f53aecc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.138072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.138048 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.138181 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.138081 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.138921 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.138887 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.138921 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.138901 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-config\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.139059 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.138930 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.139188 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.139167 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7678f2d-cc9b-444f-b023-b692f53aecc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.139480 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.139451 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7678f2d-cc9b-444f-b023-b692f53aecc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.140603 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.140585 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmzt2\" (UniqueName: \"kubernetes.io/projected/e7678f2d-cc9b-444f-b023-b692f53aecc0-kube-api-access-rmzt2\") pod \"prometheus-k8s-0\" (UID: \"e7678f2d-cc9b-444f-b023-b692f53aecc0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.281816 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.281781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:42:07.420785 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.420759 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 12:42:07.422385 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:42:07.422358 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7678f2d_cc9b_444f_b023_b692f53aecc0.slice/crio-7b935bd18fa8735c87637b791e36f81f0f484bb6d7eb8a1e58fb4000b4fedb99 WatchSource:0}: Error finding container 7b935bd18fa8735c87637b791e36f81f0f484bb6d7eb8a1e58fb4000b4fedb99: Status 404 returned error can't find the container with id 7b935bd18fa8735c87637b791e36f81f0f484bb6d7eb8a1e58fb4000b4fedb99 Jul 16 12:42:07.915107 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.915072 2567 generic.go:356] "Generic (PLEG): container finished" podID="e7678f2d-cc9b-444f-b023-b692f53aecc0" containerID="2eb18b6f7808d0f8dc24c4ce7083149364f31ecc8c3e79fb087a8205db0a507d" exitCode=0 Jul 16 12:42:07.915282 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.915164 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerDied","Data":"2eb18b6f7808d0f8dc24c4ce7083149364f31ecc8c3e79fb087a8205db0a507d"} Jul 16 12:42:07.915282 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:07.915262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"7b935bd18fa8735c87637b791e36f81f0f484bb6d7eb8a1e58fb4000b4fedb99"} Jul 16 12:42:08.923013 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.922976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"c1f7b439fa03f0e9892231cc83a3935cc9c68504db76a61327bf5d88e3170ba8"} Jul 16 12:42:08.923484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.923054 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"29e2937c357546c6fa3b52502eb6ceefe1e30c7b026c46afdaff41a5ca0ffeff"} Jul 16 12:42:08.923484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.923096 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"0b03a567f46f988ca081f7d8ba93fb5f2e057eaf731d920bdf1814272862b3a5"} Jul 16 12:42:08.923484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.923135 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"891ed733aeee554145c11e962ff7453f994bc955498d09ef4c8792fdb854dc6f"} Jul 16 12:42:08.923484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.923177 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"83bfaf0fa5f76da77c83ba797e8702d847f5f641f4cbd1225cf868ca59db7d4d"} Jul 16 12:42:08.923484 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.923220 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7678f2d-cc9b-444f-b023-b692f53aecc0","Type":"ContainerStarted","Data":"5bdd12491e095bacef50e30509efac95d043c4e933d0d0517b81b5a6f0a8b42b"} Jul 16 12:42:08.952209 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:08.952152 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.933138679 podStartE2EDuration="2.952130779s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.9921ms" isStatefulPod=false podCreationTimestamp="2026-07-16 12:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:42:08.949658524 +0000 UTC m=+170.611318607" watchObservedRunningTime="2026-07-16 12:42:08.952130779 +0000 UTC m=+170.613790861" Jul 16 12:42:12.282460 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:42:12.282368 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:43:07.282700 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:07.282659 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:43:07.298556 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:07.298523 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:43:08.179576 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:08.179549 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 12:43:17.013147 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.013108 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p4gw8"] Jul 16 12:43:17.015368 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.015351 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.017773 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.017727 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wqncr\"" Jul 16 12:43:17.017773 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.017766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 12:43:17.018565 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.018549 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 12:43:17.027144 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.027111 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p4gw8"] Jul 16 12:43:17.148054 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.148013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm5d8\" (UniqueName: \"kubernetes.io/projected/e42e68b0-0222-4d23-b6ba-bd46b77bc0b4-kube-api-access-xm5d8\") pod \"cert-manager-55b4d954d5-p4gw8\" (UID: \"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4\") " pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.148230 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.148100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e42e68b0-0222-4d23-b6ba-bd46b77bc0b4-bound-sa-token\") pod \"cert-manager-55b4d954d5-p4gw8\" (UID: \"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4\") " pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.249133 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.249093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e42e68b0-0222-4d23-b6ba-bd46b77bc0b4-bound-sa-token\") pod \"cert-manager-55b4d954d5-p4gw8\" (UID: \"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4\") " pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.249310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.249149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm5d8\" (UniqueName: \"kubernetes.io/projected/e42e68b0-0222-4d23-b6ba-bd46b77bc0b4-kube-api-access-xm5d8\") pod \"cert-manager-55b4d954d5-p4gw8\" (UID: \"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4\") " pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.257116 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.257086 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm5d8\" (UniqueName: \"kubernetes.io/projected/e42e68b0-0222-4d23-b6ba-bd46b77bc0b4-kube-api-access-xm5d8\") pod \"cert-manager-55b4d954d5-p4gw8\" (UID: \"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4\") " pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.257231 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.257140 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e42e68b0-0222-4d23-b6ba-bd46b77bc0b4-bound-sa-token\") pod \"cert-manager-55b4d954d5-p4gw8\" (UID: \"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4\") " pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.324599 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.324509 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p4gw8" Jul 16 12:43:17.456018 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:17.455994 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p4gw8"] Jul 16 12:43:17.458319 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:43:17.458291 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode42e68b0_0222_4d23_b6ba_bd46b77bc0b4.slice/crio-df27ad07210cb538c6ec0a15ff474f13228aa607ab4e80d28ff241bb340dc77d WatchSource:0}: Error finding container df27ad07210cb538c6ec0a15ff474f13228aa607ab4e80d28ff241bb340dc77d: Status 404 returned error can't find the container with id df27ad07210cb538c6ec0a15ff474f13228aa607ab4e80d28ff241bb340dc77d Jul 16 12:43:18.206137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:18.206099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p4gw8" event={"ID":"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4","Type":"ContainerStarted","Data":"df27ad07210cb538c6ec0a15ff474f13228aa607ab4e80d28ff241bb340dc77d"} Jul 16 12:43:21.222572 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:21.222535 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p4gw8" event={"ID":"e42e68b0-0222-4d23-b6ba-bd46b77bc0b4","Type":"ContainerStarted","Data":"ddf8029af0884d6ac18b549eaf082e4093f795a6825a615a3cddd4066aaf4bcd"} Jul 16 12:43:21.240443 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:21.240392 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-p4gw8" podStartSLOduration=2.335193811 podStartE2EDuration="5.240376455s" totalImagesPullingTime="2.905182644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:43:21.239460293 +0000 UTC m=+242.901120377" watchObservedRunningTime="2026-07-16 12:43:21.240376455 +0000 UTC m=+242.902036537" Jul 16 12:43:44.411544 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.411464 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc"] Jul 16 12:43:44.413847 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.413830 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.416462 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.416440 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 12:43:44.416814 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.416798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 12:43:44.417364 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.417334 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 12:43:44.417415 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.417338 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 12:43:44.417476 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.417460 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lqknb\"" Jul 16 12:43:44.447328 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.447300 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc"] Jul 16 12:43:44.473756 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.473705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.473938 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.473768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-manifests\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.473938 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.473805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwk7\" (UniqueName: \"kubernetes.io/projected/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-kube-api-access-kzwk7\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.473938 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.473843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-tmp\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.473938 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.473858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.574235 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.574197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.574235 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.574238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-manifests\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.574495 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.574268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwk7\" (UniqueName: \"kubernetes.io/projected/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-kube-api-access-kzwk7\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.574495 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.574303 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-tmp\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.574495 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.574422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.574707 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.574678 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-manifests\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.576657 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.576620 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-tmp\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.576911 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.576890 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.576980 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.576898 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.582228 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.582207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwk7\" (UniqueName: \"kubernetes.io/projected/7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9-kube-api-access-kzwk7\") pod \"opendatahub-operator-controller-manager-65f8bdf75c-fgbzc\" (UID: \"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9\") " pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.724128 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.724038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:43:44.870678 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:44.870592 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc"] Jul 16 12:43:44.873270 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:43:44.873239 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6f2f6b_2a2b_4ac5_85a8_dd2b41b154f9.slice/crio-d98717d81621a3aa52e348509b09bbffff7d0e7a044509180b93944174e1b9b7 WatchSource:0}: Error finding container d98717d81621a3aa52e348509b09bbffff7d0e7a044509180b93944174e1b9b7: Status 404 returned error can't find the container with id d98717d81621a3aa52e348509b09bbffff7d0e7a044509180b93944174e1b9b7 Jul 16 12:43:45.318150 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:45.318116 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" event={"ID":"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9","Type":"ContainerStarted","Data":"d98717d81621a3aa52e348509b09bbffff7d0e7a044509180b93944174e1b9b7"} Jul 16 12:43:48.335900 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:48.335815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" event={"ID":"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9","Type":"ContainerStarted","Data":"fd71adb75a3dcf5cdd19c19e6960bcc6ae4ac696935a7d9b632d103d81d06bda"} Jul 16 12:43:49.341964 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:49.341924 2567 generic.go:356] "Generic (PLEG): container finished" podID="7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9" containerID="fd71adb75a3dcf5cdd19c19e6960bcc6ae4ac696935a7d9b632d103d81d06bda" exitCode=0 Jul 16 12:43:49.342422 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:49.342007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" event={"ID":"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9","Type":"ContainerDied","Data":"fd71adb75a3dcf5cdd19c19e6960bcc6ae4ac696935a7d9b632d103d81d06bda"} Jul 16 12:43:50.349700 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:50.349661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" event={"ID":"7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9","Type":"ContainerStarted","Data":"c695043456af7c22a1b8d4f1458c938f55c76ecd933e49619e7de85d30f5302f"} Jul 16 12:43:50.377019 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:50.376958 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" podStartSLOduration=1.7712699509999998 podStartE2EDuration="6.376939841s" totalImagesPullingTime="3.51286486s" totalInitContainerRuntime="1.09280503s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:43:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:43:50.37541748 +0000 UTC m=+272.037077589" watchObservedRunningTime="2026-07-16 12:43:50.376939841 +0000 UTC m=+272.038599976" Jul 16 12:43:51.353863 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:43:51.353833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:44:02.361619 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:02.361589 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65f8bdf75c-fgbzc" Jul 16 12:44:13.093085 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.093043 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg"] Jul 16 12:44:13.095777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.095753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.098304 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.098280 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wmf9c\"" Jul 16 12:44:13.099362 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.099335 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 12:44:13.099492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.099358 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 12:44:13.099492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.099394 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 12:44:13.099492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.099335 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 12:44:13.099668 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.099652 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 12:44:13.108202 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.108162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg"] Jul 16 12:44:13.225997 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.225964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb21056-fe86-44c7-9152-040f5145c931-cert\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.226157 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.226006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7bz7\" (UniqueName: \"kubernetes.io/projected/ceb21056-fe86-44c7-9152-040f5145c931-kube-api-access-f7bz7\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.226157 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.226062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ceb21056-fe86-44c7-9152-040f5145c931-manager-config\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.226157 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.226078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceb21056-fe86-44c7-9152-040f5145c931-metrics-cert\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.327048 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.327007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb21056-fe86-44c7-9152-040f5145c931-cert\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.327048 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.327055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7bz7\" (UniqueName: \"kubernetes.io/projected/ceb21056-fe86-44c7-9152-040f5145c931-kube-api-access-f7bz7\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.327271 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.327181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ceb21056-fe86-44c7-9152-040f5145c931-manager-config\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.327271 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.327214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceb21056-fe86-44c7-9152-040f5145c931-metrics-cert\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.327861 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.327838 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ceb21056-fe86-44c7-9152-040f5145c931-manager-config\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.329520 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.329499 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ceb21056-fe86-44c7-9152-040f5145c931-metrics-cert\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.329520 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.329509 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb21056-fe86-44c7-9152-040f5145c931-cert\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.335250 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.335230 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7bz7\" (UniqueName: \"kubernetes.io/projected/ceb21056-fe86-44c7-9152-040f5145c931-kube-api-access-f7bz7\") pod \"lws-controller-manager-596f9f8f6b-n4xfg\" (UID: \"ceb21056-fe86-44c7-9152-040f5145c931\") " pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.399339 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.399303 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b"] Jul 16 12:44:13.402352 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.402324 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.405137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.404983 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 12:44:13.405137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.405010 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 12:44:13.405137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.405034 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 12:44:13.405137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.405041 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 12:44:13.405137 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.405088 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 12:44:13.405439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.405372 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 12:44:13.405579 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.405560 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cp5wj\"" Jul 16 12:44:13.408256 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.408239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:13.418812 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.418781 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b"] Jul 16 12:44:13.529340 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.529506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529347 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd257892-d1b0-4c08-b7c2-6fbcea34b598-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.529506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.529506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxs2\" (UniqueName: \"kubernetes.io/projected/fd257892-d1b0-4c08-b7c2-6fbcea34b598-kube-api-access-xkxs2\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.529506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.529506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.529506 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.529501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.550303 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.550274 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg"] Jul 16 12:44:13.553230 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:44:13.553185 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb21056_fe86_44c7_9152_040f5145c931.slice/crio-16b619432c1d823491169b9aa01b2e75f008335cae67f91828263d951e92fcc8 WatchSource:0}: Error finding container 16b619432c1d823491169b9aa01b2e75f008335cae67f91828263d951e92fcc8: Status 404 returned error can't find the container with id 16b619432c1d823491169b9aa01b2e75f008335cae67f91828263d951e92fcc8 Jul 16 12:44:13.630281 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.630493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd257892-d1b0-4c08-b7c2-6fbcea34b598-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.630493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.630493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxs2\" (UniqueName: \"kubernetes.io/projected/fd257892-d1b0-4c08-b7c2-6fbcea34b598-kube-api-access-xkxs2\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.630493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630417 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.630493 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.630784 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.630516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.631330 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.631299 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.632858 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.632835 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.632984 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.632914 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.633769 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.633721 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd257892-d1b0-4c08-b7c2-6fbcea34b598-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.633848 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.633725 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.643025 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.643003 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd257892-d1b0-4c08-b7c2-6fbcea34b598-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.643270 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.643252 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxs2\" (UniqueName: \"kubernetes.io/projected/fd257892-d1b0-4c08-b7c2-6fbcea34b598-kube-api-access-xkxs2\") pod \"istiod-openshift-gateway-94bb8fbfd-gzk2b\" (UID: \"fd257892-d1b0-4c08-b7c2-6fbcea34b598\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.713453 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.713363 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:13.879281 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:13.873650 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b"] Jul 16 12:44:13.879281 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:44:13.876895 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd257892_d1b0_4c08_b7c2_6fbcea34b598.slice/crio-c0d7c0c4f0ae433ce0dd4e251fc634552e5db63a5ab40a92bf0dcbaed1c1c757 WatchSource:0}: Error finding container c0d7c0c4f0ae433ce0dd4e251fc634552e5db63a5ab40a92bf0dcbaed1c1c757: Status 404 returned error can't find the container with id c0d7c0c4f0ae433ce0dd4e251fc634552e5db63a5ab40a92bf0dcbaed1c1c757 Jul 16 12:44:14.466982 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:14.466894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" event={"ID":"fd257892-d1b0-4c08-b7c2-6fbcea34b598","Type":"ContainerStarted","Data":"c0d7c0c4f0ae433ce0dd4e251fc634552e5db63a5ab40a92bf0dcbaed1c1c757"} Jul 16 12:44:14.468877 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:14.468842 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" event={"ID":"ceb21056-fe86-44c7-9152-040f5145c931","Type":"ContainerStarted","Data":"16b619432c1d823491169b9aa01b2e75f008335cae67f91828263d951e92fcc8"} Jul 16 12:44:16.900069 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:16.900029 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:44:16.900357 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:16.900102 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 12:44:17.489950 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:17.489910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" event={"ID":"fd257892-d1b0-4c08-b7c2-6fbcea34b598","Type":"ContainerStarted","Data":"1f7f185da1849d8ac77bbe24412a1c17d1c1a325fc2930228c4e05a26dc5751a"} Jul 16 12:44:17.490290 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:17.490236 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:17.491806 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:17.491780 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-gzk2b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 12:44:17.491945 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:17.491843 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" podUID="fd257892-d1b0-4c08-b7c2-6fbcea34b598" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 12:44:17.513301 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:17.513225 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" podStartSLOduration=1.494373097 podStartE2EDuration="4.51320699s" totalImagesPullingTime="3.018833893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:44:17.511392398 +0000 UTC m=+299.173052504" watchObservedRunningTime="2026-07-16 12:44:17.51320699 +0000 UTC m=+299.174867087" Jul 16 12:44:18.496313 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:18.496282 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gzk2b" Jul 16 12:44:18.743180 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:18.743147 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:44:18.743668 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:18.743648 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:44:18.746935 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:18.746870 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 12:44:19.500918 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:19.500877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" event={"ID":"ceb21056-fe86-44c7-9152-040f5145c931","Type":"ContainerStarted","Data":"eeb85312e9974ed4ee6a9d53d2937b53aea00a0b4a762d4d8d7492551dfae245"} Jul 16 12:44:19.502355 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:19.501075 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:44:19.548628 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:19.548571 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" podStartSLOduration=1.3477672840000001 podStartE2EDuration="6.548555628s" totalImagesPullingTime="5.200788344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:44:19.546844189 +0000 UTC m=+301.208504277" watchObservedRunningTime="2026-07-16 12:44:19.548555628 +0000 UTC m=+301.210215712" Jul 16 12:44:30.507634 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:44:30.507603 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-596f9f8f6b-n4xfg" Jul 16 12:46:05.375107 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.375064 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh"] Jul 16 12:46:05.378546 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.378518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.380980 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.380955 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 12:46:05.381141 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.381021 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 12:46:05.381211 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.381156 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nxk26\"" Jul 16 12:46:05.394223 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.394193 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh"] Jul 16 12:46:05.543242 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.543199 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76k9k\" (UniqueName: \"kubernetes.io/projected/0aeab584-ea2e-4edd-8921-f69b9451f10a-kube-api-access-76k9k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.543428 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.543310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeab584-ea2e-4edd-8921-f69b9451f10a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.644803 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.644684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76k9k\" (UniqueName: \"kubernetes.io/projected/0aeab584-ea2e-4edd-8921-f69b9451f10a-kube-api-access-76k9k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.644948 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.644859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeab584-ea2e-4edd-8921-f69b9451f10a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.645248 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.645228 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeab584-ea2e-4edd-8921-f69b9451f10a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.653553 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.653524 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76k9k\" (UniqueName: \"kubernetes.io/projected/0aeab584-ea2e-4edd-8921-f69b9451f10a-kube-api-access-76k9k\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.689424 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.689384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:05.863224 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.863199 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh"] Jul 16 12:46:05.865664 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:46:05.865639 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeab584_ea2e_4edd_8921_f69b9451f10a.slice/crio-bdf2fd8589d89ba63d294dbdf94217fe2c82cde23145ae7b61b7cfac96d1ca62 WatchSource:0}: Error finding container bdf2fd8589d89ba63d294dbdf94217fe2c82cde23145ae7b61b7cfac96d1ca62: Status 404 returned error can't find the container with id bdf2fd8589d89ba63d294dbdf94217fe2c82cde23145ae7b61b7cfac96d1ca62 Jul 16 12:46:05.868188 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.868171 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:46:05.992206 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:05.992120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" event={"ID":"0aeab584-ea2e-4edd-8921-f69b9451f10a","Type":"ContainerStarted","Data":"bdf2fd8589d89ba63d294dbdf94217fe2c82cde23145ae7b61b7cfac96d1ca62"} Jul 16 12:46:06.384389 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.384350 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh"] Jul 16 12:46:06.393560 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.393529 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh"] Jul 16 12:46:06.458052 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.458019 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq"] Jul 16 12:46:06.461970 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.461947 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.553238 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.553197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2hdqq\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.553455 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.553430 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vq7\" (UniqueName: \"kubernetes.io/projected/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-kube-api-access-s6vq7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2hdqq\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.574073 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.574009 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq"] Jul 16 12:46:06.654353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.654273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vq7\" (UniqueName: \"kubernetes.io/projected/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-kube-api-access-s6vq7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2hdqq\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.654353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.654335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2hdqq\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.654708 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.654680 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2hdqq\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.669310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.669277 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vq7\" (UniqueName: \"kubernetes.io/projected/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-kube-api-access-s6vq7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2hdqq\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:06.775047 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:06.775012 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:07.284882 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:07.284859 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq"] Jul 16 12:46:07.287062 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:46:07.287025 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b773e1_5d0a_4a3e_a074_4ab4cf245ee5.slice/crio-2f82d30d80fc65684ddfa69160f73e5b061b932d49ad54d38fed2bc9bebdbc3b WatchSource:0}: Error finding container 2f82d30d80fc65684ddfa69160f73e5b061b932d49ad54d38fed2bc9bebdbc3b: Status 404 returned error can't find the container with id 2f82d30d80fc65684ddfa69160f73e5b061b932d49ad54d38fed2bc9bebdbc3b Jul 16 12:46:08.008122 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:08.008074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" event={"ID":"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5","Type":"ContainerStarted","Data":"2f82d30d80fc65684ddfa69160f73e5b061b932d49ad54d38fed2bc9bebdbc3b"} Jul 16 12:46:11.025395 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.025348 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" event={"ID":"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5","Type":"ContainerStarted","Data":"157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80"} Jul 16 12:46:11.025897 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.025497 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:11.027042 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.027017 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" containerName="manager" containerID="cri-o://068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee" gracePeriod=2 Jul 16 12:46:11.046725 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.046574 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" podStartSLOduration=1.985471837 podStartE2EDuration="5.046553091s" totalImagesPullingTime="3.061081254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:11.045419886 +0000 UTC m=+412.707079995" watchObservedRunningTime="2026-07-16 12:46:11.046553091 +0000 UTC m=+412.708213177" Jul 16 12:46:11.047268 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:46:11.047240 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:11.269141 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.269116 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:11.271169 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:46:11.271141 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:11.293625 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.293542 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76k9k\" (UniqueName: \"kubernetes.io/projected/0aeab584-ea2e-4edd-8921-f69b9451f10a-kube-api-access-76k9k\") pod \"0aeab584-ea2e-4edd-8921-f69b9451f10a\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " Jul 16 12:46:11.293777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.293637 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeab584-ea2e-4edd-8921-f69b9451f10a-extensions-socket-volume\") pod \"0aeab584-ea2e-4edd-8921-f69b9451f10a\" (UID: \"0aeab584-ea2e-4edd-8921-f69b9451f10a\") " Jul 16 12:46:11.293959 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.293934 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aeab584-ea2e-4edd-8921-f69b9451f10a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0aeab584-ea2e-4edd-8921-f69b9451f10a" (UID: "0aeab584-ea2e-4edd-8921-f69b9451f10a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:11.296294 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.296261 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aeab584-ea2e-4edd-8921-f69b9451f10a-kube-api-access-76k9k" (OuterVolumeSpecName: "kube-api-access-76k9k") pod "0aeab584-ea2e-4edd-8921-f69b9451f10a" (UID: "0aeab584-ea2e-4edd-8921-f69b9451f10a"). InnerVolumeSpecName "kube-api-access-76k9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:46:11.394302 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.394261 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeab584-ea2e-4edd-8921-f69b9451f10a-extensions-socket-volume\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:46:11.394302 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:11.394296 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76k9k\" (UniqueName: \"kubernetes.io/projected/0aeab584-ea2e-4edd-8921-f69b9451f10a-kube-api-access-76k9k\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:46:12.033266 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:12.033228 2567 generic.go:356] "Generic (PLEG): container finished" podID="0aeab584-ea2e-4edd-8921-f69b9451f10a" containerID="068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee" exitCode=2 Jul 16 12:46:12.033725 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:12.033272 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:12.033725 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:12.033328 2567 scope.go:117] "RemoveContainer" containerID="068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee" Jul 16 12:46:12.035414 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:46:12.035386 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:12.042956 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:12.042939 2567 scope.go:117] "RemoveContainer" containerID="068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee" Jul 16 12:46:12.043249 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:46:12.043230 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee\": container with ID starting with 068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee not found: ID does not exist" containerID="068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee" Jul 16 12:46:12.043309 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:12.043258 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee"} err="failed to get container status \"068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee\": rpc error: code = NotFound desc = could not find container \"068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee\": container with ID starting with 068ccf6b380f3df3ed990eceb77730318ac32d9808045227223ddf31c9c000ee not found: ID does not exist" Jul 16 12:46:12.043682 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:46:12.043657 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2m9mh\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2m9mh" Jul 16 12:46:12.976197 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:12.976165 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" path="/var/lib/kubelet/pods/0aeab584-ea2e-4edd-8921-f69b9451f10a/volumes" Jul 16 12:46:22.035879 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:22.035844 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:34.651827 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:34.651787 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq"] Jul 16 12:46:34.652363 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:34.651991 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" podUID="d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" containerName="manager" containerID="cri-o://157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80" gracePeriod=10 Jul 16 12:46:34.906134 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:34.906070 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:35.013881 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.013850 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6vq7\" (UniqueName: \"kubernetes.io/projected/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-kube-api-access-s6vq7\") pod \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " Jul 16 12:46:35.014061 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.013963 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-extensions-socket-volume\") pod \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\" (UID: \"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5\") " Jul 16 12:46:35.014352 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.014325 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" (UID: "d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 12:46:35.015962 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.015937 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-kube-api-access-s6vq7" (OuterVolumeSpecName: "kube-api-access-s6vq7") pod "d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" (UID: "d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5"). InnerVolumeSpecName "kube-api-access-s6vq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:46:35.114702 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.114660 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6vq7\" (UniqueName: \"kubernetes.io/projected/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-kube-api-access-s6vq7\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:46:35.114702 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.114696 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5-extensions-socket-volume\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:46:35.142245 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.142209 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" containerID="157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80" exitCode=0 Jul 16 12:46:35.142394 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.142254 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" event={"ID":"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5","Type":"ContainerDied","Data":"157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80"} Jul 16 12:46:35.142394 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.142295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" event={"ID":"d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5","Type":"ContainerDied","Data":"2f82d30d80fc65684ddfa69160f73e5b061b932d49ad54d38fed2bc9bebdbc3b"} Jul 16 12:46:35.142394 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.142317 2567 scope.go:117] "RemoveContainer" containerID="157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80" Jul 16 12:46:35.142394 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.142259 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq" Jul 16 12:46:35.151072 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.151049 2567 scope.go:117] "RemoveContainer" containerID="157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80" Jul 16 12:46:35.151340 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:46:35.151323 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80\": container with ID starting with 157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80 not found: ID does not exist" containerID="157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80" Jul 16 12:46:35.151383 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.151349 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80"} err="failed to get container status \"157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80\": rpc error: code = NotFound desc = could not find container \"157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80\": container with ID starting with 157b91a8061ced2efa259834bdeb24b4b3ff07c63486a4a3a59de459196bdc80 not found: ID does not exist" Jul 16 12:46:35.162983 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.162929 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq"] Jul 16 12:46:35.168998 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:35.168976 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2hdqq"] Jul 16 12:46:36.976347 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:36.976309 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" path="/var/lib/kubelet/pods/d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5/volumes" Jul 16 12:46:52.678594 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678508 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:46:52.678985 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678887 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" containerName="manager" Jul 16 12:46:52.678985 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678898 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" containerName="manager" Jul 16 12:46:52.678985 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678906 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" containerName="manager" Jul 16 12:46:52.678985 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678911 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" containerName="manager" Jul 16 12:46:52.678985 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678977 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aeab584-ea2e-4edd-8921-f69b9451f10a" containerName="manager" Jul 16 12:46:52.678985 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.678986 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b773e1-5d0a-4a3e-a074-4ab4cf245ee5" containerName="manager" Jul 16 12:46:52.681194 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.681174 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.683724 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.683698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 12:46:52.683852 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.683698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 16 12:46:52.683852 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.683752 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 12:46:52.684772 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.684754 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w5vrd\"" Jul 16 12:46:52.689815 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.689793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:46:52.767129 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.767096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dq7\" (UniqueName: \"kubernetes.io/projected/143056a9-7fc7-4c62-bad3-c187f1291d50-kube-api-access-w7dq7\") pod \"limitador-limitador-64c94fd64f-7vc9d\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.767310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.767168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/143056a9-7fc7-4c62-bad3-c187f1291d50-config-file\") pod \"limitador-limitador-64c94fd64f-7vc9d\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.774263 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.774233 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:46:52.868224 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.868192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dq7\" (UniqueName: \"kubernetes.io/projected/143056a9-7fc7-4c62-bad3-c187f1291d50-kube-api-access-w7dq7\") pod \"limitador-limitador-64c94fd64f-7vc9d\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.868397 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.868246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/143056a9-7fc7-4c62-bad3-c187f1291d50-config-file\") pod \"limitador-limitador-64c94fd64f-7vc9d\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.868938 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.868918 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/143056a9-7fc7-4c62-bad3-c187f1291d50-config-file\") pod \"limitador-limitador-64c94fd64f-7vc9d\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.880633 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.880608 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dq7\" (UniqueName: \"kubernetes.io/projected/143056a9-7fc7-4c62-bad3-c187f1291d50-kube-api-access-w7dq7\") pod \"limitador-limitador-64c94fd64f-7vc9d\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:52.992674 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:52.992587 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:53.124663 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:53.124634 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:46:53.126623 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:46:53.126598 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143056a9_7fc7_4c62_bad3_c187f1291d50.slice/crio-2309052a30be6674d98b37809e789e9e1107fb412f4b9daeda290115321bba59 WatchSource:0}: Error finding container 2309052a30be6674d98b37809e789e9e1107fb412f4b9daeda290115321bba59: Status 404 returned error can't find the container with id 2309052a30be6674d98b37809e789e9e1107fb412f4b9daeda290115321bba59 Jul 16 12:46:53.225550 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:53.225516 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" event={"ID":"143056a9-7fc7-4c62-bad3-c187f1291d50","Type":"ContainerStarted","Data":"2309052a30be6674d98b37809e789e9e1107fb412f4b9daeda290115321bba59"} Jul 16 12:46:56.243249 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:56.243163 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" event={"ID":"143056a9-7fc7-4c62-bad3-c187f1291d50","Type":"ContainerStarted","Data":"935adf335fa808cf5296d612ae3f72584887c0d6468babd1a73e7c302f1946da"} Jul 16 12:46:56.243601 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:56.243279 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:46:56.261669 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:46:56.261619 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" podStartSLOduration=1.527957096 podStartE2EDuration="4.261597704s" totalImagesPullingTime="2.733640608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:46:56.259609195 +0000 UTC m=+457.921269303" watchObservedRunningTime="2026-07-16 12:46:56.261597704 +0000 UTC m=+457.923257787" Jul 16 12:47:07.249317 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:07.249276 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:47:09.829182 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:09.829149 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:47:09.829638 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:09.829376 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" podUID="143056a9-7fc7-4c62-bad3-c187f1291d50" containerName="limitador" containerID="cri-o://935adf335fa808cf5296d612ae3f72584887c0d6468babd1a73e7c302f1946da" gracePeriod=30 Jul 16 12:47:10.312547 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.312502 2567 generic.go:356] "Generic (PLEG): container finished" podID="143056a9-7fc7-4c62-bad3-c187f1291d50" containerID="935adf335fa808cf5296d612ae3f72584887c0d6468babd1a73e7c302f1946da" exitCode=0 Jul 16 12:47:10.312691 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.312568 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" event={"ID":"143056a9-7fc7-4c62-bad3-c187f1291d50","Type":"ContainerDied","Data":"935adf335fa808cf5296d612ae3f72584887c0d6468babd1a73e7c302f1946da"} Jul 16 12:47:10.370984 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.370959 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:47:10.423480 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.423381 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7dq7\" (UniqueName: \"kubernetes.io/projected/143056a9-7fc7-4c62-bad3-c187f1291d50-kube-api-access-w7dq7\") pod \"143056a9-7fc7-4c62-bad3-c187f1291d50\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " Jul 16 12:47:10.423480 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.423464 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/143056a9-7fc7-4c62-bad3-c187f1291d50-config-file\") pod \"143056a9-7fc7-4c62-bad3-c187f1291d50\" (UID: \"143056a9-7fc7-4c62-bad3-c187f1291d50\") " Jul 16 12:47:10.423858 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.423832 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/143056a9-7fc7-4c62-bad3-c187f1291d50-config-file" (OuterVolumeSpecName: "config-file") pod "143056a9-7fc7-4c62-bad3-c187f1291d50" (UID: "143056a9-7fc7-4c62-bad3-c187f1291d50"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 12:47:10.425553 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.425524 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143056a9-7fc7-4c62-bad3-c187f1291d50-kube-api-access-w7dq7" (OuterVolumeSpecName: "kube-api-access-w7dq7") pod "143056a9-7fc7-4c62-bad3-c187f1291d50" (UID: "143056a9-7fc7-4c62-bad3-c187f1291d50"). InnerVolumeSpecName "kube-api-access-w7dq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:47:10.524607 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.524564 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7dq7\" (UniqueName: \"kubernetes.io/projected/143056a9-7fc7-4c62-bad3-c187f1291d50-kube-api-access-w7dq7\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:47:10.524607 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:10.524598 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/143056a9-7fc7-4c62-bad3-c187f1291d50-config-file\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:47:11.318786 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:11.318678 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" Jul 16 12:47:11.318786 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:11.318671 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7vc9d" event={"ID":"143056a9-7fc7-4c62-bad3-c187f1291d50","Type":"ContainerDied","Data":"2309052a30be6674d98b37809e789e9e1107fb412f4b9daeda290115321bba59"} Jul 16 12:47:11.319228 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:11.318814 2567 scope.go:117] "RemoveContainer" containerID="935adf335fa808cf5296d612ae3f72584887c0d6468babd1a73e7c302f1946da" Jul 16 12:47:11.336334 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:11.336300 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:47:11.341907 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:11.341878 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7vc9d"] Jul 16 12:47:12.975889 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:12.975855 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="143056a9-7fc7-4c62-bad3-c187f1291d50" path="/var/lib/kubelet/pods/143056a9-7fc7-4c62-bad3-c187f1291d50/volumes" Jul 16 12:47:15.666325 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.666289 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv"] Jul 16 12:47:15.666703 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.666681 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="143056a9-7fc7-4c62-bad3-c187f1291d50" containerName="limitador" Jul 16 12:47:15.666703 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.666694 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="143056a9-7fc7-4c62-bad3-c187f1291d50" containerName="limitador" Jul 16 12:47:15.666812 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.666781 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="143056a9-7fc7-4c62-bad3-c187f1291d50" containerName="limitador" Jul 16 12:47:15.670044 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.670018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.672310 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.672286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 12:47:15.672439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.672384 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 16 12:47:15.673210 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.673191 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 12:47:15.673210 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.673201 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vg64s\"" Jul 16 12:47:15.680891 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.680863 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv"] Jul 16 12:47:15.773352 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.773318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckwf6\" (UniqueName: \"kubernetes.io/projected/06feb07c-ffaa-4654-aa3a-cb82938f72a6-kube-api-access-ckwf6\") pod \"postgres-69fb4594cf-x7qwv\" (UID: \"06feb07c-ffaa-4654-aa3a-cb82938f72a6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.773534 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.773405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/06feb07c-ffaa-4654-aa3a-cb82938f72a6-data\") pod \"postgres-69fb4594cf-x7qwv\" (UID: \"06feb07c-ffaa-4654-aa3a-cb82938f72a6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.874878 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.874836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwf6\" (UniqueName: \"kubernetes.io/projected/06feb07c-ffaa-4654-aa3a-cb82938f72a6-kube-api-access-ckwf6\") pod \"postgres-69fb4594cf-x7qwv\" (UID: \"06feb07c-ffaa-4654-aa3a-cb82938f72a6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.875076 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.874929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/06feb07c-ffaa-4654-aa3a-cb82938f72a6-data\") pod \"postgres-69fb4594cf-x7qwv\" (UID: \"06feb07c-ffaa-4654-aa3a-cb82938f72a6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.875302 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.875286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/06feb07c-ffaa-4654-aa3a-cb82938f72a6-data\") pod \"postgres-69fb4594cf-x7qwv\" (UID: \"06feb07c-ffaa-4654-aa3a-cb82938f72a6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.883448 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.883421 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwf6\" (UniqueName: \"kubernetes.io/projected/06feb07c-ffaa-4654-aa3a-cb82938f72a6-kube-api-access-ckwf6\") pod \"postgres-69fb4594cf-x7qwv\" (UID: \"06feb07c-ffaa-4654-aa3a-cb82938f72a6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:15.982422 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:15.982322 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:16.115692 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:16.115656 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv"] Jul 16 12:47:16.118196 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:47:16.118165 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06feb07c_ffaa_4654_aa3a_cb82938f72a6.slice/crio-736f2c50e90f0d5b8110ec57949ddac7dd9597649cef1acfa3ab2937c5455c86 WatchSource:0}: Error finding container 736f2c50e90f0d5b8110ec57949ddac7dd9597649cef1acfa3ab2937c5455c86: Status 404 returned error can't find the container with id 736f2c50e90f0d5b8110ec57949ddac7dd9597649cef1acfa3ab2937c5455c86 Jul 16 12:47:16.343879 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:16.343792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" event={"ID":"06feb07c-ffaa-4654-aa3a-cb82938f72a6","Type":"ContainerStarted","Data":"736f2c50e90f0d5b8110ec57949ddac7dd9597649cef1acfa3ab2937c5455c86"} Jul 16 12:47:21.253765 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:21.253725 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 16 12:47:21.374306 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:21.374274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" event={"ID":"06feb07c-ffaa-4654-aa3a-cb82938f72a6","Type":"ContainerStarted","Data":"ec2adbd1e7d4c877d656b895dafeb7360e2499355d02da3a268527ea70326ddd"} Jul 16 12:47:21.374496 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:21.374352 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:21.389868 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:21.389811 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" podStartSLOduration=1.258030636 podStartE2EDuration="6.389794615s" totalImagesPullingTime="5.131763979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:47:21.389543515 +0000 UTC m=+483.051203631" watchObservedRunningTime="2026-07-16 12:47:21.389794615 +0000 UTC m=+483.051454698" Jul 16 12:47:27.410176 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:27.410146 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-x7qwv" Jul 16 12:47:34.896373 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:34.896331 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b585f8d99-6x849"] Jul 16 12:47:34.918639 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:34.918609 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b585f8d99-6x849"] Jul 16 12:47:34.918821 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:34.918760 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:34.921386 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:34.921363 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 12:47:34.921529 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:34.921393 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-slqq2\"" Jul 16 12:47:34.921596 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:34.921471 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 12:47:35.058522 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.058480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.058702 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.058559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcskm\" (UniqueName: \"kubernetes.io/projected/cdc802be-44a7-4b61-9303-6106b5094d12-kube-api-access-gcskm\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.073919 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.073887 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c685789b-2bhwt"] Jul 16 12:47:35.076801 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.076783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.099027 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.099000 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c685789b-2bhwt"] Jul 16 12:47:35.159914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.159812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.159914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.159885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcskm\" (UniqueName: \"kubernetes.io/projected/cdc802be-44a7-4b61-9303-6106b5094d12-kube-api-access-gcskm\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.160099 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:47:35.159995 2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 16 12:47:35.160099 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:47:35.160072 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert podName:cdc802be-44a7-4b61-9303-6106b5094d12 nodeName:}" failed. No retries permitted until 2026-07-16 12:47:35.660051787 +0000 UTC m=+497.321711854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert") pod "maas-controller-5b585f8d99-6x849" (UID: "cdc802be-44a7-4b61-9303-6106b5094d12") : secret "maas-controller-webhook-cert" not found Jul 16 12:47:35.173527 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.173501 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcskm\" (UniqueName: \"kubernetes.io/projected/cdc802be-44a7-4b61-9303-6106b5094d12-kube-api-access-gcskm\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.260830 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.260794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc4b058-6366-4a62-a669-7e448447fa11-webhook-cert\") pod \"maas-controller-56c685789b-2bhwt\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.261016 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.260854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzw9\" (UniqueName: \"kubernetes.io/projected/edc4b058-6366-4a62-a669-7e448447fa11-kube-api-access-kmzw9\") pod \"maas-controller-56c685789b-2bhwt\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.362386 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.362349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc4b058-6366-4a62-a669-7e448447fa11-webhook-cert\") pod \"maas-controller-56c685789b-2bhwt\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.362566 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.362416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzw9\" (UniqueName: \"kubernetes.io/projected/edc4b058-6366-4a62-a669-7e448447fa11-kube-api-access-kmzw9\") pod \"maas-controller-56c685789b-2bhwt\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.364843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.364822 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc4b058-6366-4a62-a669-7e448447fa11-webhook-cert\") pod \"maas-controller-56c685789b-2bhwt\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.370658 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.370632 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzw9\" (UniqueName: \"kubernetes.io/projected/edc4b058-6366-4a62-a669-7e448447fa11-kube-api-access-kmzw9\") pod \"maas-controller-56c685789b-2bhwt\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.387494 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.387460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:35.524789 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.524765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c685789b-2bhwt"] Jul 16 12:47:35.526945 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:47:35.526915 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc4b058_6366_4a62_a669_7e448447fa11.slice/crio-5292b1e329f12f97407bed349d6c30da3cfbf43e3d25a8ce72c75f56693b7713 WatchSource:0}: Error finding container 5292b1e329f12f97407bed349d6c30da3cfbf43e3d25a8ce72c75f56693b7713: Status 404 returned error can't find the container with id 5292b1e329f12f97407bed349d6c30da3cfbf43e3d25a8ce72c75f56693b7713 Jul 16 12:47:35.664465 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.664424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.666906 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.666874 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert\") pod \"maas-controller-5b585f8d99-6x849\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.829509 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.829416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:35.962714 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:35.962683 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b585f8d99-6x849"] Jul 16 12:47:35.965142 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:47:35.965116 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc802be_44a7_4b61_9303_6106b5094d12.slice/crio-1b0cd0669a941b8409326e21c7422d38030f81938bd0f50dfd7f061c1c5eb9ca WatchSource:0}: Error finding container 1b0cd0669a941b8409326e21c7422d38030f81938bd0f50dfd7f061c1c5eb9ca: Status 404 returned error can't find the container with id 1b0cd0669a941b8409326e21c7422d38030f81938bd0f50dfd7f061c1c5eb9ca Jul 16 12:47:36.448914 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:36.448871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b585f8d99-6x849" event={"ID":"cdc802be-44a7-4b61-9303-6106b5094d12","Type":"ContainerStarted","Data":"1b0cd0669a941b8409326e21c7422d38030f81938bd0f50dfd7f061c1c5eb9ca"} Jul 16 12:47:36.450582 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:36.450542 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-2bhwt" event={"ID":"edc4b058-6366-4a62-a669-7e448447fa11","Type":"ContainerStarted","Data":"5292b1e329f12f97407bed349d6c30da3cfbf43e3d25a8ce72c75f56693b7713"} Jul 16 12:47:38.462048 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:38.462009 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b585f8d99-6x849" event={"ID":"cdc802be-44a7-4b61-9303-6106b5094d12","Type":"ContainerStarted","Data":"c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62"} Jul 16 12:47:38.462517 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:38.462106 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:38.463647 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:38.463625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-2bhwt" event={"ID":"edc4b058-6366-4a62-a669-7e448447fa11","Type":"ContainerStarted","Data":"b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe"} Jul 16 12:47:38.463781 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:38.463679 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:38.480333 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:38.480287 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b585f8d99-6x849" podStartSLOduration=2.42054516 podStartE2EDuration="4.480273863s" totalImagesPullingTime="2.059728703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:47:38.478930218 +0000 UTC m=+500.140590302" watchObservedRunningTime="2026-07-16 12:47:38.480273863 +0000 UTC m=+500.141933947" Jul 16 12:47:38.504435 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:38.504381 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56c685789b-2bhwt" podStartSLOduration=1.007212333 podStartE2EDuration="3.504364031s" totalImagesPullingTime="2.497151698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:47:38.503410933 +0000 UTC m=+500.165071016" watchObservedRunningTime="2026-07-16 12:47:38.504364031 +0000 UTC m=+500.166024114" Jul 16 12:47:49.471062 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.471029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:49.471429 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.471101 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:47:49.536464 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.536426 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b585f8d99-6x849"] Jul 16 12:47:49.536651 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.536628 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b585f8d99-6x849" podUID="cdc802be-44a7-4b61-9303-6106b5094d12" containerName="manager" containerID="cri-o://c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62" gracePeriod=30 Jul 16 12:47:49.786136 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.786110 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:49.886198 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.886162 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert\") pod \"cdc802be-44a7-4b61-9303-6106b5094d12\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " Jul 16 12:47:49.886364 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.886219 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcskm\" (UniqueName: \"kubernetes.io/projected/cdc802be-44a7-4b61-9303-6106b5094d12-kube-api-access-gcskm\") pod \"cdc802be-44a7-4b61-9303-6106b5094d12\" (UID: \"cdc802be-44a7-4b61-9303-6106b5094d12\") " Jul 16 12:47:49.888411 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.888381 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cdc802be-44a7-4b61-9303-6106b5094d12" (UID: "cdc802be-44a7-4b61-9303-6106b5094d12"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:47:49.888511 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.888385 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc802be-44a7-4b61-9303-6106b5094d12-kube-api-access-gcskm" (OuterVolumeSpecName: "kube-api-access-gcskm") pod "cdc802be-44a7-4b61-9303-6106b5094d12" (UID: "cdc802be-44a7-4b61-9303-6106b5094d12"). InnerVolumeSpecName "kube-api-access-gcskm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:47:49.987892 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.987852 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdc802be-44a7-4b61-9303-6106b5094d12-webhook-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:47:49.987892 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:49.987885 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcskm\" (UniqueName: \"kubernetes.io/projected/cdc802be-44a7-4b61-9303-6106b5094d12-kube-api-access-gcskm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:47:50.520948 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.520907 2567 generic.go:356] "Generic (PLEG): container finished" podID="cdc802be-44a7-4b61-9303-6106b5094d12" containerID="c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62" exitCode=0 Jul 16 12:47:50.521341 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.520957 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b585f8d99-6x849" Jul 16 12:47:50.521341 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.520994 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b585f8d99-6x849" event={"ID":"cdc802be-44a7-4b61-9303-6106b5094d12","Type":"ContainerDied","Data":"c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62"} Jul 16 12:47:50.521341 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.521053 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b585f8d99-6x849" event={"ID":"cdc802be-44a7-4b61-9303-6106b5094d12","Type":"ContainerDied","Data":"1b0cd0669a941b8409326e21c7422d38030f81938bd0f50dfd7f061c1c5eb9ca"} Jul 16 12:47:50.521341 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.521074 2567 scope.go:117] "RemoveContainer" containerID="c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62" Jul 16 12:47:50.529912 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.529889 2567 scope.go:117] "RemoveContainer" containerID="c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62" Jul 16 12:47:50.530192 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:47:50.530173 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62\": container with ID starting with c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62 not found: ID does not exist" containerID="c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62" Jul 16 12:47:50.530241 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.530200 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62"} err="failed to get container status \"c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62\": rpc error: code = NotFound desc = could not find container \"c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62\": container with ID starting with c6002bbeb93558e77e83a2499377546cb99a090f4d1ac32e270e95e88411ff62 not found: ID does not exist" Jul 16 12:47:50.548938 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.548877 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b585f8d99-6x849"] Jul 16 12:47:50.549107 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.548963 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b585f8d99-6x849"] Jul 16 12:47:50.976499 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:47:50.976468 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc802be-44a7-4b61-9303-6106b5094d12" path="/var/lib/kubelet/pods/cdc802be-44a7-4b61-9303-6106b5094d12/volumes" Jul 16 12:48:10.779443 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.779209 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9"] Jul 16 12:48:10.780552 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.780065 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc802be-44a7-4b61-9303-6106b5094d12" containerName="manager" Jul 16 12:48:10.780552 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.780086 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc802be-44a7-4b61-9303-6106b5094d12" containerName="manager" Jul 16 12:48:10.780552 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.780257 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc802be-44a7-4b61-9303-6106b5094d12" containerName="manager" Jul 16 12:48:10.786018 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.785985 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.788614 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.788585 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dgzx9\"" Jul 16 12:48:10.788777 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.788641 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 16 12:48:10.790095 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.790071 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9"] Jul 16 12:48:10.884619 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.884579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d54dccc-fc99-4f90-aa65-ce0d5781f722-openshift-service-ca\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.884848 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.884646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnsk2\" (UniqueName: \"kubernetes.io/projected/1d54dccc-fc99-4f90-aa65-ce0d5781f722-kube-api-access-tnsk2\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.884931 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.884844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d54dccc-fc99-4f90-aa65-ce0d5781f722-maas-api-tls\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.985591 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.985551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d54dccc-fc99-4f90-aa65-ce0d5781f722-openshift-service-ca\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.985819 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.985602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnsk2\" (UniqueName: \"kubernetes.io/projected/1d54dccc-fc99-4f90-aa65-ce0d5781f722-kube-api-access-tnsk2\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.985819 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.985689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d54dccc-fc99-4f90-aa65-ce0d5781f722-maas-api-tls\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.985946 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:48:10.985819 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 16 12:48:10.985946 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:48:10.985903 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d54dccc-fc99-4f90-aa65-ce0d5781f722-maas-api-tls podName:1d54dccc-fc99-4f90-aa65-ce0d5781f722 nodeName:}" failed. No retries permitted until 2026-07-16 12:48:11.485879542 +0000 UTC m=+533.147539621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1d54dccc-fc99-4f90-aa65-ce0d5781f722-maas-api-tls") pod "maas-api-7b559b66dd-qm4c9" (UID: "1d54dccc-fc99-4f90-aa65-ce0d5781f722") : secret "maas-api-serving-cert" not found Jul 16 12:48:10.986261 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.986241 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d54dccc-fc99-4f90-aa65-ce0d5781f722-openshift-service-ca\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:10.995213 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:10.995188 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnsk2\" (UniqueName: \"kubernetes.io/projected/1d54dccc-fc99-4f90-aa65-ce0d5781f722-kube-api-access-tnsk2\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:11.389241 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.389199 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl"] Jul 16 12:48:11.393328 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.393303 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.395630 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.395553 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 12:48:11.395630 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.395553 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-59g87\"" Jul 16 12:48:11.401598 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.401579 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl"] Jul 16 12:48:11.427750 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.427704 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4mcww"] Jul 16 12:48:11.431196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.431176 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.442288 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.442262 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4mcww"] Jul 16 12:48:11.490321 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.490288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d54dccc-fc99-4f90-aa65-ce0d5781f722-maas-api-tls\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:11.490492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.490353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2stds\" (UniqueName: \"kubernetes.io/projected/6eb79286-9a2c-4e3b-83c6-462421996f12-kube-api-access-2stds\") pod \"payload-pre-processing-74584bb9f8-nzgrl\" (UID: \"6eb79286-9a2c-4e3b-83c6-462421996f12\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.490492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.490421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eb79286-9a2c-4e3b-83c6-462421996f12-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-nzgrl\" (UID: \"6eb79286-9a2c-4e3b-83c6-462421996f12\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.492890 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.492863 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d54dccc-fc99-4f90-aa65-ce0d5781f722-maas-api-tls\") pod \"maas-api-7b559b66dd-qm4c9\" (UID: \"1d54dccc-fc99-4f90-aa65-ce0d5781f722\") " pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:11.591196 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.591151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2stds\" (UniqueName: \"kubernetes.io/projected/6eb79286-9a2c-4e3b-83c6-462421996f12-kube-api-access-2stds\") pod \"payload-pre-processing-74584bb9f8-nzgrl\" (UID: \"6eb79286-9a2c-4e3b-83c6-462421996f12\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.591404 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.591210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/086c19d3-dd99-46f9-bfe0-6c6135304858-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4mcww\" (UID: \"086c19d3-dd99-46f9-bfe0-6c6135304858\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.591404 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.591234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxdv\" (UniqueName: \"kubernetes.io/projected/086c19d3-dd99-46f9-bfe0-6c6135304858-kube-api-access-9jxdv\") pod \"payload-processing-f9b8d9b9b-4mcww\" (UID: \"086c19d3-dd99-46f9-bfe0-6c6135304858\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.591404 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.591273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eb79286-9a2c-4e3b-83c6-462421996f12-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-nzgrl\" (UID: \"6eb79286-9a2c-4e3b-83c6-462421996f12\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.592192 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.592172 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eb79286-9a2c-4e3b-83c6-462421996f12-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-nzgrl\" (UID: \"6eb79286-9a2c-4e3b-83c6-462421996f12\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.599073 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.599050 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2stds\" (UniqueName: \"kubernetes.io/projected/6eb79286-9a2c-4e3b-83c6-462421996f12-kube-api-access-2stds\") pod \"payload-pre-processing-74584bb9f8-nzgrl\" (UID: \"6eb79286-9a2c-4e3b-83c6-462421996f12\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.692534 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.692444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/086c19d3-dd99-46f9-bfe0-6c6135304858-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4mcww\" (UID: \"086c19d3-dd99-46f9-bfe0-6c6135304858\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.692534 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.692488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxdv\" (UniqueName: \"kubernetes.io/projected/086c19d3-dd99-46f9-bfe0-6c6135304858-kube-api-access-9jxdv\") pod \"payload-processing-f9b8d9b9b-4mcww\" (UID: \"086c19d3-dd99-46f9-bfe0-6c6135304858\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.693211 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.693188 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/086c19d3-dd99-46f9-bfe0-6c6135304858-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4mcww\" (UID: \"086c19d3-dd99-46f9-bfe0-6c6135304858\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.697850 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.697826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:11.700273 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.700247 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxdv\" (UniqueName: \"kubernetes.io/projected/086c19d3-dd99-46f9-bfe0-6c6135304858-kube-api-access-9jxdv\") pod \"payload-processing-f9b8d9b9b-4mcww\" (UID: \"086c19d3-dd99-46f9-bfe0-6c6135304858\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.705051 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.705026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:11.741889 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.741845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:11.881080 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.881050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9"] Jul 16 12:48:11.883557 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:48:11.883525 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d54dccc_fc99_4f90_aa65_ce0d5781f722.slice/crio-0ea37ede2cbbb0d4cfadf0ae0de1beb630a5d8271234d4ea92ef53ad2e131641 WatchSource:0}: Error finding container 0ea37ede2cbbb0d4cfadf0ae0de1beb630a5d8271234d4ea92ef53ad2e131641: Status 404 returned error can't find the container with id 0ea37ede2cbbb0d4cfadf0ae0de1beb630a5d8271234d4ea92ef53ad2e131641 Jul 16 12:48:11.909756 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.909699 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl"] Jul 16 12:48:11.911938 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:48:11.911906 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb79286_9a2c_4e3b_83c6_462421996f12.slice/crio-e90e1a665f972be39f80828dc46dbd27ccf4bf2597c73201e088d3c6ad1e6087 WatchSource:0}: Error finding container e90e1a665f972be39f80828dc46dbd27ccf4bf2597c73201e088d3c6ad1e6087: Status 404 returned error can't find the container with id e90e1a665f972be39f80828dc46dbd27ccf4bf2597c73201e088d3c6ad1e6087 Jul 16 12:48:11.935270 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:11.935246 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4mcww"] Jul 16 12:48:11.937631 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:48:11.937606 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086c19d3_dd99_46f9_bfe0_6c6135304858.slice/crio-5bbf2eba36d2249d42cfee9a125b496309984fa5e530a18962a63f740b066929 WatchSource:0}: Error finding container 5bbf2eba36d2249d42cfee9a125b496309984fa5e530a18962a63f740b066929: Status 404 returned error can't find the container with id 5bbf2eba36d2249d42cfee9a125b496309984fa5e530a18962a63f740b066929 Jul 16 12:48:12.630325 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:12.630283 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" event={"ID":"6eb79286-9a2c-4e3b-83c6-462421996f12","Type":"ContainerStarted","Data":"e90e1a665f972be39f80828dc46dbd27ccf4bf2597c73201e088d3c6ad1e6087"} Jul 16 12:48:12.631910 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:12.631859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" event={"ID":"086c19d3-dd99-46f9-bfe0-6c6135304858","Type":"ContainerStarted","Data":"5bbf2eba36d2249d42cfee9a125b496309984fa5e530a18962a63f740b066929"} Jul 16 12:48:12.633191 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:12.633169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" event={"ID":"1d54dccc-fc99-4f90-aa65-ce0d5781f722","Type":"ContainerStarted","Data":"0ea37ede2cbbb0d4cfadf0ae0de1beb630a5d8271234d4ea92ef53ad2e131641"} Jul 16 12:48:13.641625 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:13.641518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" event={"ID":"6eb79286-9a2c-4e3b-83c6-462421996f12","Type":"ContainerStarted","Data":"afbb13d7302f1f6a1fb678bed1973dc9e972038252e78137c10b19b8bac002a7"} Jul 16 12:48:13.641625 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:13.641588 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:13.643415 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:13.643386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" event={"ID":"086c19d3-dd99-46f9-bfe0-6c6135304858","Type":"ContainerStarted","Data":"7566777abce9790b7c08ad5d2ef405a26d4982187b1d60a0f3cdcff8df7b2137"} Jul 16 12:48:13.643548 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:13.643532 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:13.659510 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:13.659454 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" podStartSLOduration=1.407358243 podStartE2EDuration="2.659436643s" totalImagesPullingTime="1.2520784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:48:13.657811584 +0000 UTC m=+535.319471695" watchObservedRunningTime="2026-07-16 12:48:13.659436643 +0000 UTC m=+535.321096725" Jul 16 12:48:13.674782 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:13.674709 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" podStartSLOduration=1.4457955120000001 podStartE2EDuration="2.674692684s" totalImagesPullingTime="1.228897172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:48:13.673482475 +0000 UTC m=+535.335142583" watchObservedRunningTime="2026-07-16 12:48:13.674692684 +0000 UTC m=+535.336352767" Jul 16 12:48:14.650167 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:14.650125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" event={"ID":"1d54dccc-fc99-4f90-aa65-ce0d5781f722","Type":"ContainerStarted","Data":"f75261281dfefb197a39cdc42b080c622e3210da3f1dba31423db263cf50f51b"} Jul 16 12:48:14.672960 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:14.672897 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" podStartSLOduration=2.031270022 podStartE2EDuration="4.672880555s" totalImagesPullingTime="2.641610533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:48:14.671948431 +0000 UTC m=+536.333608537" watchObservedRunningTime="2026-07-16 12:48:14.672880555 +0000 UTC m=+536.334540638" Jul 16 12:48:15.654849 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:15.654815 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:21.665702 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:21.665668 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b559b66dd-qm4c9" Jul 16 12:48:24.652528 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:24.652498 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-4mcww" Jul 16 12:48:24.652994 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:24.652689 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-nzgrl" Jul 16 12:48:37.946300 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.946267 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk"] Jul 16 12:48:37.951211 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.951186 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:37.953747 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.953710 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 12:48:37.954798 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.954776 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 12:48:37.954920 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.954903 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 12:48:37.954984 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.954785 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7jchv\"" Jul 16 12:48:37.978699 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:37.978668 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk"] Jul 16 12:48:38.032439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.032404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.032439 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.032438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2ee69f-05a8-47c7-8e5b-28f62898e954-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.032696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.032454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.032696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.032519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fcqq\" (UniqueName: \"kubernetes.io/projected/dd2ee69f-05a8-47c7-8e5b-28f62898e954-kube-api-access-8fcqq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.032696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.032622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.032838 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.032717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134106 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134301 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134301 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134301 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2ee69f-05a8-47c7-8e5b-28f62898e954-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134481 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134481 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fcqq\" (UniqueName: \"kubernetes.io/projected/dd2ee69f-05a8-47c7-8e5b-28f62898e954-kube-api-access-8fcqq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134632 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134608 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134692 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134674 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.134863 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.134836 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.136712 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.136683 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2ee69f-05a8-47c7-8e5b-28f62898e954-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.137635 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.137615 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2ee69f-05a8-47c7-8e5b-28f62898e954-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.143277 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.143254 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fcqq\" (UniqueName: \"kubernetes.io/projected/dd2ee69f-05a8-47c7-8e5b-28f62898e954-kube-api-access-8fcqq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk\" (UID: \"dd2ee69f-05a8-47c7-8e5b-28f62898e954\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.262992 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.262903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:38.401869 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.401841 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk"] Jul 16 12:48:38.404581 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:48:38.404554 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2ee69f_05a8_47c7_8e5b_28f62898e954.slice/crio-35896052f12923a281a224d6d0cf9da69950cb647090306b41521403be179275 WatchSource:0}: Error finding container 35896052f12923a281a224d6d0cf9da69950cb647090306b41521403be179275: Status 404 returned error can't find the container with id 35896052f12923a281a224d6d0cf9da69950cb647090306b41521403be179275 Jul 16 12:48:38.763582 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:38.763548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" event={"ID":"dd2ee69f-05a8-47c7-8e5b-28f62898e954","Type":"ContainerStarted","Data":"35896052f12923a281a224d6d0cf9da69950cb647090306b41521403be179275"} Jul 16 12:48:39.770843 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:39.770806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" event={"ID":"dd2ee69f-05a8-47c7-8e5b-28f62898e954","Type":"ContainerStarted","Data":"7936904e779d71ef431ed9b84c6914cd923d3be1507daa4c5d79eb597c8553d6"} Jul 16 12:48:39.790434 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:39.790372 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" podStartSLOduration=1.521764745 podStartE2EDuration="2.790355214s" totalImagesPullingTime="1.268590469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:48:39.787815855 +0000 UTC m=+561.449475963" watchObservedRunningTime="2026-07-16 12:48:39.790355214 +0000 UTC m=+561.452015297" Jul 16 12:48:48.263840 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:48.263794 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:48.264232 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:48.263912 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:48.276409 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:48.276381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:48:48.823797 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:48:48.823762 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk" Jul 16 12:49:03.776783 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.776721 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-spshq"] Jul 16 12:49:03.783323 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.783298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.785584 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.785560 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 12:49:03.789433 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.789405 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-spshq"] Jul 16 12:49:03.881549 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.881515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.881778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.881566 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.881778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.881591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9l6\" (UniqueName: \"kubernetes.io/projected/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-kube-api-access-tg9l6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.881778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.881680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.881778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.881719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.881989 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.881818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.982578 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.982542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.982578 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.982580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.982849 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.982663 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.982849 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.982760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.982849 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.982821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.982984 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.982848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9l6\" (UniqueName: \"kubernetes.io/projected/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-kube-api-access-tg9l6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.983421 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.983391 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.983421 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.983420 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.983616 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.983561 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.985194 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.985178 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.985369 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.985352 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:03.990451 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:03.990431 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9l6\" (UniqueName: \"kubernetes.io/projected/5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db-kube-api-access-tg9l6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-spshq\" (UID: \"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:04.095467 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:04.095382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:04.236688 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:04.236661 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-spshq"] Jul 16 12:49:04.238461 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:49:04.238434 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9665d5_1e9c_4396_bfb5_3d4f1d60a5db.slice/crio-a25546d8fa00fcff36671406f436001c06b653404b38bb8104b14b7c9a0bc40a WatchSource:0}: Error finding container a25546d8fa00fcff36671406f436001c06b653404b38bb8104b14b7c9a0bc40a: Status 404 returned error can't find the container with id a25546d8fa00fcff36671406f436001c06b653404b38bb8104b14b7c9a0bc40a Jul 16 12:49:04.890127 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:04.890090 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" event={"ID":"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db","Type":"ContainerStarted","Data":"7362bca91d0cf1aa2232a0f6326576485b4b5d5a768c32d72c87b3aefec4bc90"} Jul 16 12:49:04.890574 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:04.890143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" event={"ID":"5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db","Type":"ContainerStarted","Data":"a25546d8fa00fcff36671406f436001c06b653404b38bb8104b14b7c9a0bc40a"} Jul 16 12:49:04.908364 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:04.908312 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" podStartSLOduration=1.706879711 podStartE2EDuration="1.908296384s" totalImagesPullingTime="201.416673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:49:04.907249079 +0000 UTC m=+586.568909206" watchObservedRunningTime="2026-07-16 12:49:04.908296384 +0000 UTC m=+586.569956468" Jul 16 12:49:14.095672 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:14.095629 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:14.096192 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:14.095699 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:14.108371 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:14.108343 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:14.951714 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:14.951687 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-spshq" Jul 16 12:49:18.775818 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:18.775791 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:49:18.776292 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:49:18.775889 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:51:21.929492 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:21.929402 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c685789b-2bhwt"] Jul 16 12:51:21.930018 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:21.929642 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56c685789b-2bhwt" podUID="edc4b058-6366-4a62-a669-7e448447fa11" containerName="manager" containerID="cri-o://b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe" gracePeriod=30 Jul 16 12:51:22.180948 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.180881 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:51:22.282563 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.282529 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmzw9\" (UniqueName: \"kubernetes.io/projected/edc4b058-6366-4a62-a669-7e448447fa11-kube-api-access-kmzw9\") pod \"edc4b058-6366-4a62-a669-7e448447fa11\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " Jul 16 12:51:22.282774 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.282611 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc4b058-6366-4a62-a669-7e448447fa11-webhook-cert\") pod \"edc4b058-6366-4a62-a669-7e448447fa11\" (UID: \"edc4b058-6366-4a62-a669-7e448447fa11\") " Jul 16 12:51:22.284616 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.284576 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc4b058-6366-4a62-a669-7e448447fa11-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "edc4b058-6366-4a62-a669-7e448447fa11" (UID: "edc4b058-6366-4a62-a669-7e448447fa11"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:51:22.284761 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.284627 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc4b058-6366-4a62-a669-7e448447fa11-kube-api-access-kmzw9" (OuterVolumeSpecName: "kube-api-access-kmzw9") pod "edc4b058-6366-4a62-a669-7e448447fa11" (UID: "edc4b058-6366-4a62-a669-7e448447fa11"). InnerVolumeSpecName "kube-api-access-kmzw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:51:22.383972 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.383930 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmzw9\" (UniqueName: \"kubernetes.io/projected/edc4b058-6366-4a62-a669-7e448447fa11-kube-api-access-kmzw9\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:51:22.383972 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.383959 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc4b058-6366-4a62-a669-7e448447fa11-webhook-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:51:22.562603 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.562504 2567 generic.go:356] "Generic (PLEG): container finished" podID="edc4b058-6366-4a62-a669-7e448447fa11" containerID="b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe" exitCode=0 Jul 16 12:51:22.562603 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.562547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-2bhwt" event={"ID":"edc4b058-6366-4a62-a669-7e448447fa11","Type":"ContainerDied","Data":"b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe"} Jul 16 12:51:22.562603 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.562560 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-2bhwt" Jul 16 12:51:22.562603 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.562597 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-2bhwt" event={"ID":"edc4b058-6366-4a62-a669-7e448447fa11","Type":"ContainerDied","Data":"5292b1e329f12f97407bed349d6c30da3cfbf43e3d25a8ce72c75f56693b7713"} Jul 16 12:51:22.562989 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.562620 2567 scope.go:117] "RemoveContainer" containerID="b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe" Jul 16 12:51:22.572007 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.571989 2567 scope.go:117] "RemoveContainer" containerID="b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe" Jul 16 12:51:22.572267 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:51:22.572247 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe\": container with ID starting with b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe not found: ID does not exist" containerID="b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe" Jul 16 12:51:22.572335 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.572277 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe"} err="failed to get container status \"b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe\": rpc error: code = NotFound desc = could not find container \"b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe\": container with ID starting with b134e7354e77a4b707e13970ab18080ab6e09dbc02bfe7c5b2389b20df410fbe not found: ID does not exist" Jul 16 12:51:22.583691 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.583662 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c685789b-2bhwt"] Jul 16 12:51:22.587303 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.587281 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56c685789b-2bhwt"] Jul 16 12:51:22.976836 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:51:22.976807 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc4b058-6366-4a62-a669-7e448447fa11" path="/var/lib/kubelet/pods/edc4b058-6366-4a62-a669-7e448447fa11/volumes" Jul 16 12:52:23.400272 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.400241 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c685789b-9zhsm"] Jul 16 12:52:23.400727 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.400708 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc4b058-6366-4a62-a669-7e448447fa11" containerName="manager" Jul 16 12:52:23.400827 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.400730 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc4b058-6366-4a62-a669-7e448447fa11" containerName="manager" Jul 16 12:52:23.400909 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.400893 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc4b058-6366-4a62-a669-7e448447fa11" containerName="manager" Jul 16 12:52:23.405135 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.405112 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.408162 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.408135 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-slqq2\"" Jul 16 12:52:23.408162 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.408135 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 12:52:23.408341 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.408178 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 12:52:23.413044 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.413013 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c685789b-9zhsm"] Jul 16 12:52:23.548168 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.548129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22387162-a1e4-4145-bea5-96f22d9c2c0d-webhook-cert\") pod \"maas-controller-56c685789b-9zhsm\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.548350 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.548180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlx5x\" (UniqueName: \"kubernetes.io/projected/22387162-a1e4-4145-bea5-96f22d9c2c0d-kube-api-access-rlx5x\") pod \"maas-controller-56c685789b-9zhsm\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.649560 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.649522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22387162-a1e4-4145-bea5-96f22d9c2c0d-webhook-cert\") pod \"maas-controller-56c685789b-9zhsm\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.649768 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.649570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlx5x\" (UniqueName: \"kubernetes.io/projected/22387162-a1e4-4145-bea5-96f22d9c2c0d-kube-api-access-rlx5x\") pod \"maas-controller-56c685789b-9zhsm\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.651994 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.651944 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22387162-a1e4-4145-bea5-96f22d9c2c0d-webhook-cert\") pod \"maas-controller-56c685789b-9zhsm\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.657519 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.657483 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlx5x\" (UniqueName: \"kubernetes.io/projected/22387162-a1e4-4145-bea5-96f22d9c2c0d-kube-api-access-rlx5x\") pod \"maas-controller-56c685789b-9zhsm\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.718548 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.718511 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:23.850332 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.850303 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c685789b-9zhsm"] Jul 16 12:52:23.852668 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:52:23.852640 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22387162_a1e4_4145_bea5_96f22d9c2c0d.slice/crio-7d8254536471f19f9c0acbd209825c83e17ae1b7c978c116b755bf357eaea7a8 WatchSource:0}: Error finding container 7d8254536471f19f9c0acbd209825c83e17ae1b7c978c116b755bf357eaea7a8: Status 404 returned error can't find the container with id 7d8254536471f19f9c0acbd209825c83e17ae1b7c978c116b755bf357eaea7a8 Jul 16 12:52:23.854406 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.854378 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 12:52:23.862288 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:23.862264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-9zhsm" event={"ID":"22387162-a1e4-4145-bea5-96f22d9c2c0d","Type":"ContainerStarted","Data":"7d8254536471f19f9c0acbd209825c83e17ae1b7c978c116b755bf357eaea7a8"} Jul 16 12:52:25.873286 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:25.873252 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-9zhsm" event={"ID":"22387162-a1e4-4145-bea5-96f22d9c2c0d","Type":"ContainerStarted","Data":"2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b"} Jul 16 12:52:25.873696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:25.873361 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:25.901810 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:25.901753 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56c685789b-9zhsm" podStartSLOduration=1.171501402 podStartE2EDuration="2.901722892s" totalImagesPullingTime="1.73022149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:25.899422889 +0000 UTC m=+787.561082993" watchObservedRunningTime="2026-07-16 12:52:25.901722892 +0000 UTC m=+787.563382974" Jul 16 12:52:36.881071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:36.881038 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:41.531994 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.531909 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c685789b-9zhsm"] Jul 16 12:52:41.532442 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.532117 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56c685789b-9zhsm" podUID="22387162-a1e4-4145-bea5-96f22d9c2c0d" containerName="manager" containerID="cri-o://2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b" gracePeriod=30 Jul 16 12:52:41.791379 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.791312 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:41.831173 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.831127 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlx5x\" (UniqueName: \"kubernetes.io/projected/22387162-a1e4-4145-bea5-96f22d9c2c0d-kube-api-access-rlx5x\") pod \"22387162-a1e4-4145-bea5-96f22d9c2c0d\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " Jul 16 12:52:41.831386 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.831225 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22387162-a1e4-4145-bea5-96f22d9c2c0d-webhook-cert\") pod \"22387162-a1e4-4145-bea5-96f22d9c2c0d\" (UID: \"22387162-a1e4-4145-bea5-96f22d9c2c0d\") " Jul 16 12:52:41.833351 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.833323 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22387162-a1e4-4145-bea5-96f22d9c2c0d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22387162-a1e4-4145-bea5-96f22d9c2c0d" (UID: "22387162-a1e4-4145-bea5-96f22d9c2c0d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 12:52:41.833540 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.833520 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22387162-a1e4-4145-bea5-96f22d9c2c0d-kube-api-access-rlx5x" (OuterVolumeSpecName: "kube-api-access-rlx5x") pod "22387162-a1e4-4145-bea5-96f22d9c2c0d" (UID: "22387162-a1e4-4145-bea5-96f22d9c2c0d"). InnerVolumeSpecName "kube-api-access-rlx5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 12:52:41.932253 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.932214 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22387162-a1e4-4145-bea5-96f22d9c2c0d-webhook-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:52:41.932253 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.932245 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlx5x\" (UniqueName: \"kubernetes.io/projected/22387162-a1e4-4145-bea5-96f22d9c2c0d-kube-api-access-rlx5x\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\"" Jul 16 12:52:41.952691 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.952652 2567 generic.go:356] "Generic (PLEG): container finished" podID="22387162-a1e4-4145-bea5-96f22d9c2c0d" containerID="2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b" exitCode=0 Jul 16 12:52:41.952874 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.952700 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-9zhsm" Jul 16 12:52:41.952874 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.952761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-9zhsm" event={"ID":"22387162-a1e4-4145-bea5-96f22d9c2c0d","Type":"ContainerDied","Data":"2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b"} Jul 16 12:52:41.952874 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.952820 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-9zhsm" event={"ID":"22387162-a1e4-4145-bea5-96f22d9c2c0d","Type":"ContainerDied","Data":"7d8254536471f19f9c0acbd209825c83e17ae1b7c978c116b755bf357eaea7a8"} Jul 16 12:52:41.952874 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.952842 2567 scope.go:117] "RemoveContainer" containerID="2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b" Jul 16 12:52:41.962071 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.962050 2567 scope.go:117] "RemoveContainer" containerID="2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b" Jul 16 12:52:41.962353 ip-10-0-143-248 kubenswrapper[2567]: E0716 12:52:41.962334 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b\": container with ID starting with 2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b not found: ID does not exist" containerID="2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b" Jul 16 12:52:41.962431 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.962367 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b"} err="failed to get container status \"2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b\": rpc error: code = NotFound desc = could not find container \"2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b\": container with ID starting with 2f3fb8ff292c2d20435b8f2db87caf2fd8382617f9e3fa707a56dfcea4cb156b not found: ID does not exist" Jul 16 12:52:41.973272 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.973248 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c685789b-9zhsm"] Jul 16 12:52:41.976963 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:41.976932 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56c685789b-9zhsm"] Jul 16 12:52:42.807177 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.807135 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c685789b-2h6x4"] Jul 16 12:52:42.807781 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.807755 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22387162-a1e4-4145-bea5-96f22d9c2c0d" containerName="manager" Jul 16 12:52:42.807781 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.807780 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="22387162-a1e4-4145-bea5-96f22d9c2c0d" containerName="manager" Jul 16 12:52:42.808012 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.807866 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="22387162-a1e4-4145-bea5-96f22d9c2c0d" containerName="manager" Jul 16 12:52:42.812142 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.812125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.815074 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.815054 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-slqq2\"" Jul 16 12:52:42.815174 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.815056 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 12:52:42.815174 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.815056 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 12:52:42.820353 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.820034 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c685789b-2h6x4"] Jul 16 12:52:42.843113 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.843082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f80b32f-a100-4e06-b0d2-3042e27dd011-webhook-cert\") pod \"maas-controller-56c685789b-2h6x4\" (UID: \"0f80b32f-a100-4e06-b0d2-3042e27dd011\") " pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.843255 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.843190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzjx\" (UniqueName: \"kubernetes.io/projected/0f80b32f-a100-4e06-b0d2-3042e27dd011-kube-api-access-crzjx\") pod \"maas-controller-56c685789b-2h6x4\" (UID: \"0f80b32f-a100-4e06-b0d2-3042e27dd011\") " pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.944696 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.944659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzjx\" (UniqueName: \"kubernetes.io/projected/0f80b32f-a100-4e06-b0d2-3042e27dd011-kube-api-access-crzjx\") pod \"maas-controller-56c685789b-2h6x4\" (UID: \"0f80b32f-a100-4e06-b0d2-3042e27dd011\") " pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.944863 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.944799 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f80b32f-a100-4e06-b0d2-3042e27dd011-webhook-cert\") pod \"maas-controller-56c685789b-2h6x4\" (UID: \"0f80b32f-a100-4e06-b0d2-3042e27dd011\") " pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.947179 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.947151 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f80b32f-a100-4e06-b0d2-3042e27dd011-webhook-cert\") pod \"maas-controller-56c685789b-2h6x4\" (UID: \"0f80b32f-a100-4e06-b0d2-3042e27dd011\") " pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.952344 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.952322 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzjx\" (UniqueName: \"kubernetes.io/projected/0f80b32f-a100-4e06-b0d2-3042e27dd011-kube-api-access-crzjx\") pod \"maas-controller-56c685789b-2h6x4\" (UID: \"0f80b32f-a100-4e06-b0d2-3042e27dd011\") " pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:42.976027 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:42.976000 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22387162-a1e4-4145-bea5-96f22d9c2c0d" path="/var/lib/kubelet/pods/22387162-a1e4-4145-bea5-96f22d9c2c0d/volumes" Jul 16 12:52:43.125424 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:43.125390 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:43.266579 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:43.266538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c685789b-2h6x4"] Jul 16 12:52:43.275467 ip-10-0-143-248 kubenswrapper[2567]: W0716 12:52:43.275432 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f80b32f_a100_4e06_b0d2_3042e27dd011.slice/crio-af88f335a187a5fde6a7dbc44ba39e31cfe847701ab8be07d590c5741e1e2e9e WatchSource:0}: Error finding container af88f335a187a5fde6a7dbc44ba39e31cfe847701ab8be07d590c5741e1e2e9e: Status 404 returned error can't find the container with id af88f335a187a5fde6a7dbc44ba39e31cfe847701ab8be07d590c5741e1e2e9e Jul 16 12:52:43.966127 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:43.966045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-2h6x4" event={"ID":"0f80b32f-a100-4e06-b0d2-3042e27dd011","Type":"ContainerStarted","Data":"7654dc5303c66531cd75042f8bc1c228097cf80f1ed4965f810dfe8e29379222"} Jul 16 12:52:43.966127 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:43.966105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c685789b-2h6x4" event={"ID":"0f80b32f-a100-4e06-b0d2-3042e27dd011","Type":"ContainerStarted","Data":"af88f335a187a5fde6a7dbc44ba39e31cfe847701ab8be07d590c5741e1e2e9e"} Jul 16 12:52:43.966558 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:43.966202 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:52:43.985879 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:43.985822 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56c685789b-2h6x4" podStartSLOduration=1.5915836479999999 podStartE2EDuration="1.985799952s" totalImagesPullingTime="394.216304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:52:43.985562031 +0000 UTC m=+805.647222114" watchObservedRunningTime="2026-07-16 12:52:43.985799952 +0000 UTC m=+805.647460037" Jul 16 12:52:54.976717 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:52:54.976687 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c685789b-2h6x4" Jul 16 12:54:18.809588 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:54:18.809510 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:54:18.812778 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:54:18.812758 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:59:18.842043 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:59:18.842016 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 12:59:18.846868 ip-10-0-143-248 kubenswrapper[2567]: I0716 12:59:18.846845 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:00:00.142245 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.142213 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m"] Jul 16 13:00:00.145850 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.145831 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" Jul 16 13:00:00.148324 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.148303 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zhdlk\"" Jul 16 13:00:00.154386 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.154353 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m"] Jul 16 13:00:00.156795 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.156774 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" Jul 16 13:00:00.301249 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.301226 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m"] Jul 16 13:00:00.303302 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:00:00.303275 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9f53b6_462d_4689_b069_8da4e12c7704.slice/crio-f566db49d46097f0addcdd8c0ed2fb0681b44877dc3a05c468a8d97dae866965 WatchSource:0}: Error finding container f566db49d46097f0addcdd8c0ed2fb0681b44877dc3a05c468a8d97dae866965: Status 404 returned error can't find the container with id f566db49d46097f0addcdd8c0ed2fb0681b44877dc3a05c468a8d97dae866965 Jul 16 13:00:00.305376 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:00.305360 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 13:00:01.094391 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:01.094348 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" event={"ID":"8f9f53b6-462d-4689-b069-8da4e12c7704","Type":"ContainerStarted","Data":"f566db49d46097f0addcdd8c0ed2fb0681b44877dc3a05c468a8d97dae866965"} Jul 16 13:00:07.125449 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:07.125414 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" event={"ID":"8f9f53b6-462d-4689-b069-8da4e12c7704","Type":"ContainerStarted","Data":"1738b6cbf5a821fa59c96884cfc9d3902875e02673eeba504902f169854d5943"} Jul 16 13:00:08.132006 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:08.131969 2567 generic.go:356] "Generic (PLEG): container finished" podID="8f9f53b6-462d-4689-b069-8da4e12c7704" containerID="1738b6cbf5a821fa59c96884cfc9d3902875e02673eeba504902f169854d5943" exitCode=0 Jul 16 13:00:08.132375 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:08.132058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" event={"ID":"8f9f53b6-462d-4689-b069-8da4e12c7704","Type":"ContainerDied","Data":"1738b6cbf5a821fa59c96884cfc9d3902875e02673eeba504902f169854d5943"} Jul 16 13:00:09.279852 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:09.279820 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" Jul 16 13:00:10.144066 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:10.144032 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" event={"ID":"8f9f53b6-462d-4689-b069-8da4e12c7704","Type":"ContainerDied","Data":"f566db49d46097f0addcdd8c0ed2fb0681b44877dc3a05c468a8d97dae866965"} Jul 16 13:00:10.144066 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:10.144057 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736780-xxh4m" Jul 16 13:00:10.144285 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:00:10.144081 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f566db49d46097f0addcdd8c0ed2fb0681b44877dc3a05c468a8d97dae866965" Jul 16 13:04:18.878139 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:18.878103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:04:18.883092 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:18.883068 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:04:29.468771 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.468656 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk"] Jul 16 13:04:29.469423 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.469209 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9f53b6-462d-4689-b069-8da4e12c7704" containerName="cleanup" Jul 16 13:04:29.469423 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.469231 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9f53b6-462d-4689-b069-8da4e12c7704" containerName="cleanup" Jul 16 13:04:29.469423 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.469348 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f9f53b6-462d-4689-b069-8da4e12c7704" containerName="cleanup" Jul 16 13:04:29.472504 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.472484 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.474854 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.474832 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-60a47609-serving-cert\"" Jul 16 13:04:29.483988 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.483948 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk"] Jul 16 13:04:29.557458 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.557423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18e021a4-e474-4990-9417-40b40b837172-maas-api-tls\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.557645 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.557582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18e021a4-e474-4990-9417-40b40b837172-openshift-service-ca\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.557645 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.557627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwlv7\" (UniqueName: \"kubernetes.io/projected/18e021a4-e474-4990-9417-40b40b837172-kube-api-access-fwlv7\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.658530 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.658482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18e021a4-e474-4990-9417-40b40b837172-openshift-service-ca\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.658727 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.658548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwlv7\" (UniqueName: \"kubernetes.io/projected/18e021a4-e474-4990-9417-40b40b837172-kube-api-access-fwlv7\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.658727 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.658583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18e021a4-e474-4990-9417-40b40b837172-maas-api-tls\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.658849 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:29.658767 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-serving-cert: secret "maas-api-e2e-ait-60a47609-serving-cert" not found Jul 16 13:04:29.658849 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:29.658826 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18e021a4-e474-4990-9417-40b40b837172-maas-api-tls podName:18e021a4-e474-4990-9417-40b40b837172 nodeName:}" failed. No retries permitted until 2026-07-16 13:04:30.15880983 +0000 UTC m=+1511.820469890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18e021a4-e474-4990-9417-40b40b837172-maas-api-tls") pod "maas-api-e2e-ait-60a47609-778584b86b-kcblk" (UID: "18e021a4-e474-4990-9417-40b40b837172") : secret "maas-api-e2e-ait-60a47609-serving-cert" not found Jul 16 13:04:29.659339 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.659312 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18e021a4-e474-4990-9417-40b40b837172-openshift-service-ca\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:29.666883 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:29.666859 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwlv7\" (UniqueName: \"kubernetes.io/projected/18e021a4-e474-4990-9417-40b40b837172-kube-api-access-fwlv7\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:30.163814 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:30.163772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18e021a4-e474-4990-9417-40b40b837172-maas-api-tls\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:30.166206 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:30.166187 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18e021a4-e474-4990-9417-40b40b837172-maas-api-tls\") pod \"maas-api-e2e-ait-60a47609-778584b86b-kcblk\" (UID: \"18e021a4-e474-4990-9417-40b40b837172\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:30.385904 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:30.385872 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:30.530423 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:30.530397 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk"] Jul 16 13:04:30.532629 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:04:30.532600 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e021a4_e474_4990_9417_40b40b837172.slice/crio-18314d7b1e5151211b300c3e5ecf837acca0be659151d2d376d9a1cb875e21c7 WatchSource:0}: Error finding container 18314d7b1e5151211b300c3e5ecf837acca0be659151d2d376d9a1cb875e21c7: Status 404 returned error can't find the container with id 18314d7b1e5151211b300c3e5ecf837acca0be659151d2d376d9a1cb875e21c7 Jul 16 13:04:31.451086 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:31.451051 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" event={"ID":"18e021a4-e474-4990-9417-40b40b837172","Type":"ContainerStarted","Data":"18314d7b1e5151211b300c3e5ecf837acca0be659151d2d376d9a1cb875e21c7"} Jul 16 13:04:32.456915 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:32.456873 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" event={"ID":"18e021a4-e474-4990-9417-40b40b837172","Type":"ContainerStarted","Data":"1e871869a318c1a8609a01d1004e2ca3fc24d239a7134985a7f18dcd7ab8d906"} Jul 16 13:04:32.457318 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:32.457077 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:32.479053 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:32.478998 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" podStartSLOduration=2.179547635 podStartE2EDuration="3.478980883s" totalImagesPullingTime="1.299433248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:04:32.476619046 +0000 UTC m=+1514.138279152" watchObservedRunningTime="2026-07-16 13:04:32.478980883 +0000 UTC m=+1514.140640966" Jul 16 13:04:38.467280 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:38.467253 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60a47609-778584b86b-kcblk" Jul 16 13:04:42.068901 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.068805 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs"] Jul 16 13:04:42.073237 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.073214 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.075448 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.075424 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5a470a1b-serving-cert\"" Jul 16 13:04:42.082493 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.082463 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs"] Jul 16 13:04:42.176357 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.176323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4gjx\" (UniqueName: \"kubernetes.io/projected/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-kube-api-access-n4gjx\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.176520 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.176381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-openshift-service-ca\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.176520 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.176471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.277188 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.277147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.277388 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.277208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4gjx\" (UniqueName: \"kubernetes.io/projected/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-kube-api-access-n4gjx\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.277388 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.277256 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-openshift-service-ca\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.277388 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:42.277297 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-serving-cert: secret "maas-api-e2e-migrate-5a470a1b-serving-cert" not found Jul 16 13:04:42.277388 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:42.277365 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls podName:a553712a-58e0-4c8b-ae5f-7aa238ffd79b nodeName:}" failed. No retries permitted until 2026-07-16 13:04:42.777347884 +0000 UTC m=+1524.439007946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls") pod "maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" (UID: "a553712a-58e0-4c8b-ae5f-7aa238ffd79b") : secret "maas-api-e2e-migrate-5a470a1b-serving-cert" not found Jul 16 13:04:42.277984 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.277965 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-openshift-service-ca\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.287017 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.286994 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4gjx\" (UniqueName: \"kubernetes.io/projected/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-kube-api-access-n4gjx\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.783662 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:42.783625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:42.783868 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:42.783752 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-serving-cert: secret "maas-api-e2e-migrate-5a470a1b-serving-cert" not found Jul 16 13:04:42.783868 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:42.783812 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls podName:a553712a-58e0-4c8b-ae5f-7aa238ffd79b nodeName:}" failed. No retries permitted until 2026-07-16 13:04:43.783796877 +0000 UTC m=+1525.445456939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls") pod "maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" (UID: "a553712a-58e0-4c8b-ae5f-7aa238ffd79b") : secret "maas-api-e2e-migrate-5a470a1b-serving-cert" not found Jul 16 13:04:43.793195 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:43.793153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:43.795814 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:43.795793 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a553712a-58e0-4c8b-ae5f-7aa238ffd79b-maas-api-tls\") pod \"maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs\" (UID: \"a553712a-58e0-4c8b-ae5f-7aa238ffd79b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:43.886295 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:43.886254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:44.032070 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:44.032041 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs"] Jul 16 13:04:44.033961 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:04:44.033933 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda553712a_58e0_4c8b_ae5f_7aa238ffd79b.slice/crio-0058455ae2af5926f75122f0438eb7af9432a7ac45d448ec7de3ac65fcd2e594 WatchSource:0}: Error finding container 0058455ae2af5926f75122f0438eb7af9432a7ac45d448ec7de3ac65fcd2e594: Status 404 returned error can't find the container with id 0058455ae2af5926f75122f0438eb7af9432a7ac45d448ec7de3ac65fcd2e594 Jul 16 13:04:44.519563 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:44.519524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" event={"ID":"a553712a-58e0-4c8b-ae5f-7aa238ffd79b","Type":"ContainerStarted","Data":"0058455ae2af5926f75122f0438eb7af9432a7ac45d448ec7de3ac65fcd2e594"} Jul 16 13:04:46.530255 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:46.530219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" event={"ID":"a553712a-58e0-4c8b-ae5f-7aa238ffd79b","Type":"ContainerStarted","Data":"f89408a10442c8d07f283de97780ca35d387681608a0db6d6eae2583a8baf122"} Jul 16 13:04:46.530683 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:46.530340 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:46.553754 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:46.553698 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" podStartSLOduration=2.171648085 podStartE2EDuration="4.55367972s" totalImagesPullingTime="2.382031635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:04:46.551189573 +0000 UTC m=+1528.212849678" watchObservedRunningTime="2026-07-16 13:04:46.55367972 +0000 UTC m=+1528.215339803" Jul 16 13:04:52.540679 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:52.540646 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs" Jul 16 13:04:54.061942 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.061905 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw"] Jul 16 13:04:54.066567 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.066533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.069167 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.069119 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b0d8b7c2-serving-cert\"" Jul 16 13:04:54.076778 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.075809 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw"] Jul 16 13:04:54.193949 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.193847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cqk2\" (UniqueName: \"kubernetes.io/projected/d5bd3b8b-ce63-400a-bfa5-a77290418952-kube-api-access-8cqk2\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.193949 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.193894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd3b8b-ce63-400a-bfa5-a77290418952-maas-api-tls\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.194203 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.193974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd3b8b-ce63-400a-bfa5-a77290418952-openshift-service-ca\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.294969 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.294919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cqk2\" (UniqueName: \"kubernetes.io/projected/d5bd3b8b-ce63-400a-bfa5-a77290418952-kube-api-access-8cqk2\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.294969 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.294975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd3b8b-ce63-400a-bfa5-a77290418952-maas-api-tls\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.295246 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.295009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd3b8b-ce63-400a-bfa5-a77290418952-openshift-service-ca\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.295246 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:54.295129 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-serving-cert: secret "maas-api-e2e-derive-b0d8b7c2-serving-cert" not found Jul 16 13:04:54.295246 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:04:54.295194 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bd3b8b-ce63-400a-bfa5-a77290418952-maas-api-tls podName:d5bd3b8b-ce63-400a-bfa5-a77290418952 nodeName:}" failed. No retries permitted until 2026-07-16 13:04:54.795177459 +0000 UTC m=+1536.456837520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5bd3b8b-ce63-400a-bfa5-a77290418952-maas-api-tls") pod "maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" (UID: "d5bd3b8b-ce63-400a-bfa5-a77290418952") : secret "maas-api-e2e-derive-b0d8b7c2-serving-cert" not found Jul 16 13:04:54.295773 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.295729 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd3b8b-ce63-400a-bfa5-a77290418952-openshift-service-ca\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.302453 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.302427 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cqk2\" (UniqueName: \"kubernetes.io/projected/d5bd3b8b-ce63-400a-bfa5-a77290418952-kube-api-access-8cqk2\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.800961 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.800923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd3b8b-ce63-400a-bfa5-a77290418952-maas-api-tls\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.803375 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.803347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd3b8b-ce63-400a-bfa5-a77290418952-maas-api-tls\") pod \"maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw\" (UID: \"d5bd3b8b-ce63-400a-bfa5-a77290418952\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:54.981474 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:54.981444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:55.131065 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:55.131036 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw"] Jul 16 13:04:55.132852 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:04:55.132811 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bd3b8b_ce63_400a_bfa5_a77290418952.slice/crio-23836f2043e009384bd36ede81206115b93139d528c4dbc1c242837fbbe7cd8a WatchSource:0}: Error finding container 23836f2043e009384bd36ede81206115b93139d528c4dbc1c242837fbbe7cd8a: Status 404 returned error can't find the container with id 23836f2043e009384bd36ede81206115b93139d528c4dbc1c242837fbbe7cd8a Jul 16 13:04:55.576449 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:55.576401 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" event={"ID":"d5bd3b8b-ce63-400a-bfa5-a77290418952","Type":"ContainerStarted","Data":"23836f2043e009384bd36ede81206115b93139d528c4dbc1c242837fbbe7cd8a"} Jul 16 13:04:56.583122 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:56.583037 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" event={"ID":"d5bd3b8b-ce63-400a-bfa5-a77290418952","Type":"ContainerStarted","Data":"01ddd2229d83c7b0bfcba9b22e4fba1bdca43a664c48a679c2776dcdd994c715"} Jul 16 13:04:56.583507 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:56.583138 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:04:56.601713 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:04:56.601657 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" podStartSLOduration=1.61259592 podStartE2EDuration="2.601640337s" totalImagesPullingTime="989.044417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:04:56.599150852 +0000 UTC m=+1538.260810962" watchObservedRunningTime="2026-07-16 13:04:56.601640337 +0000 UTC m=+1538.263300419" Jul 16 13:05:02.594723 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:05:02.594683 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw" Jul 16 13:06:44.496785 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.496729 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx"] Jul 16 13:06:44.500437 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.500416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.502621 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.502593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-41581b25-serving-cert\"" Jul 16 13:06:44.510944 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.510915 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx"] Jul 16 13:06:44.660937 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.660899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-openshift-service-ca\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.661113 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.660991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.661113 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.661015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqnpz\" (UniqueName: \"kubernetes.io/projected/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-kube-api-access-fqnpz\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.762091 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.761995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-openshift-service-ca\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.762091 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.762074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.762328 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.762097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqnpz\" (UniqueName: \"kubernetes.io/projected/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-kube-api-access-fqnpz\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.762328 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:06:44.762216 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-serving-cert: secret "maas-api-e2e-mt-41581b25-serving-cert" not found Jul 16 13:06:44.762328 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:06:44.762300 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls podName:dd71aa3c-47ce-42cb-9bfb-4d78e80b8892 nodeName:}" failed. No retries permitted until 2026-07-16 13:06:45.262281884 +0000 UTC m=+1646.923941962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls") pod "maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" (UID: "dd71aa3c-47ce-42cb-9bfb-4d78e80b8892") : secret "maas-api-e2e-mt-41581b25-serving-cert" not found Jul 16 13:06:44.762659 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.762640 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-openshift-service-ca\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:44.770392 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:44.770367 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqnpz\" (UniqueName: \"kubernetes.io/projected/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-kube-api-access-fqnpz\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:45.267412 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:45.267371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:45.267639 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:06:45.267557 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-serving-cert: secret "maas-api-e2e-mt-41581b25-serving-cert" not found Jul 16 13:06:45.267714 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:06:45.267639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls podName:dd71aa3c-47ce-42cb-9bfb-4d78e80b8892 nodeName:}" failed. No retries permitted until 2026-07-16 13:06:46.267618915 +0000 UTC m=+1647.929278976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls") pod "maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" (UID: "dd71aa3c-47ce-42cb-9bfb-4d78e80b8892") : secret "maas-api-e2e-mt-41581b25-serving-cert" not found Jul 16 13:06:46.278521 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:46.278485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:46.280913 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:46.280893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd71aa3c-47ce-42cb-9bfb-4d78e80b8892-maas-api-tls\") pod \"maas-api-e2e-mt-41581b25-86b7947bdb-tstkx\" (UID: \"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:46.313006 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:46.312968 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:46.455776 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:46.455731 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx"] Jul 16 13:06:46.458071 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:06:46.458023 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd71aa3c_47ce_42cb_9bfb_4d78e80b8892.slice/crio-fed213f4295176f103dd67c5472834889f2e8a8c0d0eaefb2c5b5efed46b7a10 WatchSource:0}: Error finding container fed213f4295176f103dd67c5472834889f2e8a8c0d0eaefb2c5b5efed46b7a10: Status 404 returned error can't find the container with id fed213f4295176f103dd67c5472834889f2e8a8c0d0eaefb2c5b5efed46b7a10 Jul 16 13:06:46.459429 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:46.459409 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 13:06:47.151549 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:47.151503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" event={"ID":"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892","Type":"ContainerStarted","Data":"fed213f4295176f103dd67c5472834889f2e8a8c0d0eaefb2c5b5efed46b7a10"} Jul 16 13:06:49.162073 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:49.162032 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" event={"ID":"dd71aa3c-47ce-42cb-9bfb-4d78e80b8892","Type":"ContainerStarted","Data":"cb81679ffd345ef3f0d198ea87fff5c93872818bde38ca5d0c19c46e0b975181"} Jul 16 13:06:49.162570 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:49.162125 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:06:49.180238 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:49.180184 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" podStartSLOduration=2.792701074 podStartE2EDuration="5.180166403s" totalImagesPullingTime="2.387465329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:06:49.177348652 +0000 UTC m=+1650.839008770" watchObservedRunningTime="2026-07-16 13:06:49.180166403 +0000 UTC m=+1650.841826487" Jul 16 13:06:55.173306 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:06:55.173272 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41581b25-86b7947bdb-tstkx" Jul 16 13:08:22.066071 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.065986 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q"] Jul 16 13:08:22.069331 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.069312 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.071583 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.071561 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ae18e9-serving-cert\"" Jul 16 13:08:22.086236 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.086204 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q"] Jul 16 13:08:22.118070 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.118029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16fc2a43-67b5-4b82-8935-0ea765edae81-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.118244 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.118182 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16fc2a43-67b5-4b82-8935-0ea765edae81-maas-api-tls\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.118310 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.118255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pkr\" (UniqueName: \"kubernetes.io/projected/16fc2a43-67b5-4b82-8935-0ea765edae81-kube-api-access-j5pkr\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.218932 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.218897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16fc2a43-67b5-4b82-8935-0ea765edae81-maas-api-tls\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.219132 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.218947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pkr\" (UniqueName: \"kubernetes.io/projected/16fc2a43-67b5-4b82-8935-0ea765edae81-kube-api-access-j5pkr\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.219132 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.219006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16fc2a43-67b5-4b82-8935-0ea765edae81-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.219132 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:08:22.219069 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-serving-cert: secret "maas-api-e2e-inf-a-ae18e9-serving-cert" not found Jul 16 13:08:22.219318 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:08:22.219141 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fc2a43-67b5-4b82-8935-0ea765edae81-maas-api-tls podName:16fc2a43-67b5-4b82-8935-0ea765edae81 nodeName:}" failed. No retries permitted until 2026-07-16 13:08:22.719119988 +0000 UTC m=+1744.380780051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16fc2a43-67b5-4b82-8935-0ea765edae81-maas-api-tls") pod "maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" (UID: "16fc2a43-67b5-4b82-8935-0ea765edae81") : secret "maas-api-e2e-inf-a-ae18e9-serving-cert" not found Jul 16 13:08:22.219662 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.219643 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16fc2a43-67b5-4b82-8935-0ea765edae81-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.228674 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.228641 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pkr\" (UniqueName: \"kubernetes.io/projected/16fc2a43-67b5-4b82-8935-0ea765edae81-kube-api-access-j5pkr\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.723481 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.723441 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16fc2a43-67b5-4b82-8935-0ea765edae81-maas-api-tls\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.725876 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.725854 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16fc2a43-67b5-4b82-8935-0ea765edae81-maas-api-tls\") pod \"maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q\" (UID: \"16fc2a43-67b5-4b82-8935-0ea765edae81\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:22.979174 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:22.979091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:23.129532 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:23.129509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q"] Jul 16 13:08:23.132013 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:08:23.131982 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fc2a43_67b5_4b82_8935_0ea765edae81.slice/crio-1b661bb67789c30dc9d073ed67b78068ce87f6c9a79394842109b317000c2ca8 WatchSource:0}: Error finding container 1b661bb67789c30dc9d073ed67b78068ce87f6c9a79394842109b317000c2ca8: Status 404 returned error can't find the container with id 1b661bb67789c30dc9d073ed67b78068ce87f6c9a79394842109b317000c2ca8 Jul 16 13:08:23.664051 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:23.664010 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" event={"ID":"16fc2a43-67b5-4b82-8935-0ea765edae81","Type":"ContainerStarted","Data":"1b661bb67789c30dc9d073ed67b78068ce87f6c9a79394842109b317000c2ca8"} Jul 16 13:08:25.675795 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:25.675756 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" event={"ID":"16fc2a43-67b5-4b82-8935-0ea765edae81","Type":"ContainerStarted","Data":"58dc5f2b64e401a23d22c0b980908d7412a1d4478d5fa970ff152ea5db29fff6"} Jul 16 13:08:25.676274 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:25.675833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:25.705464 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:25.705407 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" podStartSLOduration=1.747966852 podStartE2EDuration="3.705390767s" totalImagesPullingTime="1.957423915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:08:25.703665642 +0000 UTC m=+1747.365325745" watchObservedRunningTime="2026-07-16 13:08:25.705390767 +0000 UTC m=+1747.367050850" Jul 16 13:08:30.147318 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.147272 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj"] Jul 16 13:08:30.152217 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.152184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.154399 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.154370 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-cb4eee-serving-cert\"" Jul 16 13:08:30.160839 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.160810 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj"] Jul 16 13:08:30.302678 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.302632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.302918 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.302748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/149bb4c4-f20b-4a35-b8ba-5b44939299b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.302918 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.302782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pclcr\" (UniqueName: \"kubernetes.io/projected/149bb4c4-f20b-4a35-b8ba-5b44939299b7-kube-api-access-pclcr\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.403627 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.403527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/149bb4c4-f20b-4a35-b8ba-5b44939299b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.403627 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.403591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclcr\" (UniqueName: \"kubernetes.io/projected/149bb4c4-f20b-4a35-b8ba-5b44939299b7-kube-api-access-pclcr\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.403909 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.403667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.403909 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:08:30.403781 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-serving-cert: secret "maas-api-e2e-inf-b-cb4eee-serving-cert" not found Jul 16 13:08:30.403909 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:08:30.403860 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls podName:149bb4c4-f20b-4a35-b8ba-5b44939299b7 nodeName:}" failed. No retries permitted until 2026-07-16 13:08:30.903839837 +0000 UTC m=+1752.565499898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls") pod "maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" (UID: "149bb4c4-f20b-4a35-b8ba-5b44939299b7") : secret "maas-api-e2e-inf-b-cb4eee-serving-cert" not found Jul 16 13:08:30.404346 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.404323 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/149bb4c4-f20b-4a35-b8ba-5b44939299b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.414310 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.414281 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pclcr\" (UniqueName: \"kubernetes.io/projected/149bb4c4-f20b-4a35-b8ba-5b44939299b7-kube-api-access-pclcr\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.908687 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:30.908645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:30.908913 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:08:30.908816 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-serving-cert: secret "maas-api-e2e-inf-b-cb4eee-serving-cert" not found Jul 16 13:08:30.908913 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:08:30.908902 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls podName:149bb4c4-f20b-4a35-b8ba-5b44939299b7 nodeName:}" failed. No retries permitted until 2026-07-16 13:08:31.908883915 +0000 UTC m=+1753.570543986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls") pod "maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" (UID: "149bb4c4-f20b-4a35-b8ba-5b44939299b7") : secret "maas-api-e2e-inf-b-cb4eee-serving-cert" not found Jul 16 13:08:31.685895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:31.685866 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q" Jul 16 13:08:31.919767 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:31.919701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:31.922143 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:31.922118 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/149bb4c4-f20b-4a35-b8ba-5b44939299b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj\" (UID: \"149bb4c4-f20b-4a35-b8ba-5b44939299b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:31.967310 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:31.967212 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:32.110367 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:32.110326 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj"] Jul 16 13:08:32.112097 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:08:32.112071 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149bb4c4_f20b_4a35_b8ba_5b44939299b7.slice/crio-9ba6a2664336ae40ca4c5eb030941689ea8b5ef45acc3adab32006b17037a075 WatchSource:0}: Error finding container 9ba6a2664336ae40ca4c5eb030941689ea8b5ef45acc3adab32006b17037a075: Status 404 returned error can't find the container with id 9ba6a2664336ae40ca4c5eb030941689ea8b5ef45acc3adab32006b17037a075 Jul 16 13:08:32.713956 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:32.713924 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" event={"ID":"149bb4c4-f20b-4a35-b8ba-5b44939299b7","Type":"ContainerStarted","Data":"9ba6a2664336ae40ca4c5eb030941689ea8b5ef45acc3adab32006b17037a075"} Jul 16 13:08:33.721192 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:33.721152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" event={"ID":"149bb4c4-f20b-4a35-b8ba-5b44939299b7","Type":"ContainerStarted","Data":"13e6c580d48206e77390588447f26bb4570f592573d366af16b9cc964c73d089"} Jul 16 13:08:33.721589 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:33.721305 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:08:33.739419 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:33.739371 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" podStartSLOduration=3.215525494 podStartE2EDuration="3.739353879s" totalImagesPullingTime="523.828385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:08:33.738349207 +0000 UTC m=+1755.400009302" watchObservedRunningTime="2026-07-16 13:08:33.739353879 +0000 UTC m=+1755.401013961" Jul 16 13:08:39.732392 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:08:39.732362 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj" Jul 16 13:09:18.914594 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:09:18.914480 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:09:18.921168 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:09:18.921147 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:10:33.862963 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.862923 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl"] Jul 16 13:10:33.867179 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.867154 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:33.869468 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.869442 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-213b02-serving-cert\"" Jul 16 13:10:33.877674 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.877650 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl"] Jul 16 13:10:33.995030 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.994983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bkwr\" (UniqueName: \"kubernetes.io/projected/f4b9b690-2b23-4dfd-8327-b1eac469e068-kube-api-access-6bkwr\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:33.995245 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.995049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b9b690-2b23-4dfd-8327-b1eac469e068-openshift-service-ca\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:33.995245 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:33.995174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b9b690-2b23-4dfd-8327-b1eac469e068-maas-api-tls\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.095716 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.095675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b9b690-2b23-4dfd-8327-b1eac469e068-openshift-service-ca\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.095924 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.095800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b9b690-2b23-4dfd-8327-b1eac469e068-maas-api-tls\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.095924 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.095849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bkwr\" (UniqueName: \"kubernetes.io/projected/f4b9b690-2b23-4dfd-8327-b1eac469e068-kube-api-access-6bkwr\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.096392 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.096364 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b9b690-2b23-4dfd-8327-b1eac469e068-openshift-service-ca\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.098502 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.098479 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b9b690-2b23-4dfd-8327-b1eac469e068-maas-api-tls\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.103707 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.103683 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bkwr\" (UniqueName: \"kubernetes.io/projected/f4b9b690-2b23-4dfd-8327-b1eac469e068-kube-api-access-6bkwr\") pod \"maas-api-e2e-api-a-213b02-6bf969b785-rf6bl\" (UID: \"f4b9b690-2b23-4dfd-8327-b1eac469e068\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.179997 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.179902 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:34.326764 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.326714 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl"] Jul 16 13:10:34.328511 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:10:34.328481 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b9b690_2b23_4dfd_8327_b1eac469e068.slice/crio-1eaa1b948445351c6bef5e66c3088fd273fd65db4e685f94513ea3984cb347bd WatchSource:0}: Error finding container 1eaa1b948445351c6bef5e66c3088fd273fd65db4e685f94513ea3984cb347bd: Status 404 returned error can't find the container with id 1eaa1b948445351c6bef5e66c3088fd273fd65db4e685f94513ea3984cb347bd Jul 16 13:10:34.371320 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:34.371274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" event={"ID":"f4b9b690-2b23-4dfd-8327-b1eac469e068","Type":"ContainerStarted","Data":"1eaa1b948445351c6bef5e66c3088fd273fd65db4e685f94513ea3984cb347bd"} Jul 16 13:10:35.377639 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:35.377604 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" event={"ID":"f4b9b690-2b23-4dfd-8327-b1eac469e068","Type":"ContainerStarted","Data":"2d9b877df6ff67ed2de793be215cc3a76b874fa4e15e8d2f959e2c15eb67a1cd"} Jul 16 13:10:35.378044 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:35.377721 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:35.397401 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:35.397351 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" podStartSLOduration=1.525206396 podStartE2EDuration="2.397334326s" totalImagesPullingTime="872.12793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:10:35.39448452 +0000 UTC m=+1877.056144603" watchObservedRunningTime="2026-07-16 13:10:35.397334326 +0000 UTC m=+1877.058994444" Jul 16 13:10:41.388454 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.388363 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-213b02-6bf969b785-rf6bl" Jul 16 13:10:41.658982 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.658908 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn"] Jul 16 13:10:41.662935 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.662908 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.665335 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.665309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a22377-serving-cert\"" Jul 16 13:10:41.676907 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.676878 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn"] Jul 16 13:10:41.778327 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.778281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-692xw\" (UniqueName: \"kubernetes.io/projected/23a8fee5-adee-41fd-a03c-365b60bc9f97-kube-api-access-692xw\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.778528 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.778405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23a8fee5-adee-41fd-a03c-365b60bc9f97-maas-api-tls\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.778528 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.778461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23a8fee5-adee-41fd-a03c-365b60bc9f97-openshift-service-ca\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.879628 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.879583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-692xw\" (UniqueName: \"kubernetes.io/projected/23a8fee5-adee-41fd-a03c-365b60bc9f97-kube-api-access-692xw\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.879875 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.879706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23a8fee5-adee-41fd-a03c-365b60bc9f97-maas-api-tls\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.879875 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.879797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23a8fee5-adee-41fd-a03c-365b60bc9f97-openshift-service-ca\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.880558 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.880531 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23a8fee5-adee-41fd-a03c-365b60bc9f97-openshift-service-ca\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.882705 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.882680 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23a8fee5-adee-41fd-a03c-365b60bc9f97-maas-api-tls\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.890178 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.890156 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-692xw\" (UniqueName: \"kubernetes.io/projected/23a8fee5-adee-41fd-a03c-365b60bc9f97-kube-api-access-692xw\") pod \"maas-api-e2e-api-b-a22377-586bd86454-q7jcn\" (UID: \"23a8fee5-adee-41fd-a03c-365b60bc9f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:41.975125 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:41.975045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:42.124639 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:42.124612 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn"] Jul 16 13:10:42.126619 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:10:42.126590 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a8fee5_adee_41fd_a03c_365b60bc9f97.slice/crio-4483700addc7eed509e2800968a95f7261185a5fa0b1a394beb69866352b11b4 WatchSource:0}: Error finding container 4483700addc7eed509e2800968a95f7261185a5fa0b1a394beb69866352b11b4: Status 404 returned error can't find the container with id 4483700addc7eed509e2800968a95f7261185a5fa0b1a394beb69866352b11b4 Jul 16 13:10:42.415501 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:42.415466 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" event={"ID":"23a8fee5-adee-41fd-a03c-365b60bc9f97","Type":"ContainerStarted","Data":"4483700addc7eed509e2800968a95f7261185a5fa0b1a394beb69866352b11b4"} Jul 16 13:10:43.422522 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:43.422481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" event={"ID":"23a8fee5-adee-41fd-a03c-365b60bc9f97","Type":"ContainerStarted","Data":"47ede72512d05d76b6eff12db1112e81efd20e31e7eb287c75d73a5d51cf01c5"} Jul 16 13:10:43.422981 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:43.422611 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:10:43.441366 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:43.441288 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" podStartSLOduration=1.68294316 podStartE2EDuration="2.441257281s" totalImagesPullingTime="758.314121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:10:43.440520562 +0000 UTC m=+1885.102180647" watchObservedRunningTime="2026-07-16 13:10:43.441257281 +0000 UTC m=+1885.102917364" Jul 16 13:10:49.433297 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:10:49.433267 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a22377-586bd86454-q7jcn" Jul 16 13:11:23.951791 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:23.951751 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9"] Jul 16 13:11:23.956314 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:23.956292 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:23.958666 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:23.958642 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b12c92-serving-cert\"" Jul 16 13:11:23.964478 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:23.964443 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9"] Jul 16 13:11:24.100938 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.100906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda9e00c-109f-4bbb-942e-5c0e2504d319-maas-api-tls\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.101145 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.101058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda9e00c-109f-4bbb-942e-5c0e2504d319-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.101145 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.101108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frttd\" (UniqueName: \"kubernetes.io/projected/eda9e00c-109f-4bbb-942e-5c0e2504d319-kube-api-access-frttd\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.202164 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.202062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda9e00c-109f-4bbb-942e-5c0e2504d319-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.202164 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.202111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frttd\" (UniqueName: \"kubernetes.io/projected/eda9e00c-109f-4bbb-942e-5c0e2504d319-kube-api-access-frttd\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.202422 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.202175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda9e00c-109f-4bbb-942e-5c0e2504d319-maas-api-tls\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.202422 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:11:24.202341 2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-serving-cert: secret "maas-api-e2e-shared-a-b12c92-serving-cert" not found Jul 16 13:11:24.202533 ip-10-0-143-248 kubenswrapper[2567]: E0716 13:11:24.202424 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda9e00c-109f-4bbb-942e-5c0e2504d319-maas-api-tls podName:eda9e00c-109f-4bbb-942e-5c0e2504d319 nodeName:}" failed. No retries permitted until 2026-07-16 13:11:24.702405374 +0000 UTC m=+1926.364065437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eda9e00c-109f-4bbb-942e-5c0e2504d319-maas-api-tls") pod "maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" (UID: "eda9e00c-109f-4bbb-942e-5c0e2504d319") : secret "maas-api-e2e-shared-a-b12c92-serving-cert" not found Jul 16 13:11:24.202764 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.202721 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda9e00c-109f-4bbb-942e-5c0e2504d319-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.211298 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.211272 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frttd\" (UniqueName: \"kubernetes.io/projected/eda9e00c-109f-4bbb-942e-5c0e2504d319-kube-api-access-frttd\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.707825 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.707778 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda9e00c-109f-4bbb-942e-5c0e2504d319-maas-api-tls\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.710200 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.710178 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda9e00c-109f-4bbb-942e-5c0e2504d319-maas-api-tls\") pod \"maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9\" (UID: \"eda9e00c-109f-4bbb-942e-5c0e2504d319\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:24.870536 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:24.870483 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:25.023927 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:25.023897 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9"] Jul 16 13:11:25.026254 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:11:25.026209 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda9e00c_109f_4bbb_942e_5c0e2504d319.slice/crio-bf88cd85e68aa0bdf02dc1d7417063919b7883056381643634e450a3f4b38806 WatchSource:0}: Error finding container bf88cd85e68aa0bdf02dc1d7417063919b7883056381643634e450a3f4b38806: Status 404 returned error can't find the container with id bf88cd85e68aa0bdf02dc1d7417063919b7883056381643634e450a3f4b38806 Jul 16 13:11:25.647229 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:25.647193 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" event={"ID":"eda9e00c-109f-4bbb-942e-5c0e2504d319","Type":"ContainerStarted","Data":"13c48ba0dcaefc0b1d7510b2ac66c0d89df2eda13006be1c62ef19170fb93e71"} Jul 16 13:11:25.647417 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:25.647246 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" event={"ID":"eda9e00c-109f-4bbb-942e-5c0e2504d319","Type":"ContainerStarted","Data":"bf88cd85e68aa0bdf02dc1d7417063919b7883056381643634e450a3f4b38806"} Jul 16 13:11:25.647417 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:25.647323 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:11:25.665934 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:25.665884 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" podStartSLOduration=2.228145136 podStartE2EDuration="2.665866996s" totalImagesPullingTime="437.72186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:11:25.664333687 +0000 UTC m=+1927.325993764" watchObservedRunningTime="2026-07-16 13:11:25.665866996 +0000 UTC m=+1927.327527079" Jul 16 13:11:31.659409 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:11:31.659370 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9" Jul 16 13:14:18.950064 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:14:18.949952 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:14:18.958039 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:14:18.958015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:15:00.179853 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.179814 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8"] Jul 16 13:15:00.184272 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.184247 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" Jul 16 13:15:00.186675 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.186650 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zhdlk\"" Jul 16 13:15:00.195796 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.195770 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8"] Jul 16 13:15:00.199694 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.199674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" Jul 16 13:15:00.348046 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.348020 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8"] Jul 16 13:15:00.350186 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:15:00.350157 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d032658_9d5a_47d3_8637_53dfadd35fee.slice/crio-78f77c542a4d367ba54ae6dd4f1d3e8f5e21da500179a531146afa354f9fc771 WatchSource:0}: Error finding container 78f77c542a4d367ba54ae6dd4f1d3e8f5e21da500179a531146afa354f9fc771: Status 404 returned error can't find the container with id 78f77c542a4d367ba54ae6dd4f1d3e8f5e21da500179a531146afa354f9fc771 Jul 16 13:15:00.811390 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.811358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" event={"ID":"3d032658-9d5a-47d3-8637-53dfadd35fee","Type":"ContainerStarted","Data":"0d4b198b8b4c271d4682f96ea975a73029a8e48d4baaa96da80424e607da18ca"} Jul 16 13:15:00.811586 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.811409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" event={"ID":"3d032658-9d5a-47d3-8637-53dfadd35fee","Type":"ContainerStarted","Data":"78f77c542a4d367ba54ae6dd4f1d3e8f5e21da500179a531146afa354f9fc771"} Jul 16 13:15:00.834618 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:00.834568 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" podStartSLOduration=0.834550181 podStartE2EDuration="834.550181ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:15:00.832497381 +0000 UTC m=+2142.494157464" watchObservedRunningTime="2026-07-16 13:15:00.834550181 +0000 UTC m=+2142.496210267" Jul 16 13:15:01.819152 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:01.819116 2567 generic.go:356] "Generic (PLEG): container finished" podID="3d032658-9d5a-47d3-8637-53dfadd35fee" containerID="0d4b198b8b4c271d4682f96ea975a73029a8e48d4baaa96da80424e607da18ca" exitCode=0 Jul 16 13:15:01.819583 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:01.819202 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" event={"ID":"3d032658-9d5a-47d3-8637-53dfadd35fee","Type":"ContainerDied","Data":"0d4b198b8b4c271d4682f96ea975a73029a8e48d4baaa96da80424e607da18ca"} Jul 16 13:15:02.969500 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:02.969474 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" Jul 16 13:15:03.830908 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:03.830879 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" Jul 16 13:15:03.830908 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:03.830886 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736795-m57p8" event={"ID":"3d032658-9d5a-47d3-8637-53dfadd35fee","Type":"ContainerDied","Data":"78f77c542a4d367ba54ae6dd4f1d3e8f5e21da500179a531146afa354f9fc771"} Jul 16 13:15:03.831176 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:15:03.830935 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78f77c542a4d367ba54ae6dd4f1d3e8f5e21da500179a531146afa354f9fc771" Jul 16 13:18:39.522503 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:39.522465 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c685789b-2h6x4_0f80b32f-a100-4e06-b0d2-3042e27dd011/manager/0.log" Jul 16 13:18:40.032203 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:40.032173 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f8bdf75c-fgbzc_7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9/copy-manifests/0.log" Jul 16 13:18:40.051113 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:40.051082 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f8bdf75c-fgbzc_7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9/manager/0.log" Jul 16 13:18:40.614325 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:40.614281 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b559b66dd-qm4c9_1d54dccc-fc99-4f90-aa65-ce0d5781f722/maas-api/0.log" Jul 16 13:18:40.735611 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:40.735573 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-60a47609-778584b86b-kcblk_18e021a4-e474-4990-9417-40b40b837172/maas-api/0.log" Jul 16 13:18:40.861969 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:40.861938 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-213b02-6bf969b785-rf6bl_f4b9b690-2b23-4dfd-8327-b1eac469e068/maas-api/0.log" Jul 16 13:18:40.985507 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:40.985418 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-a22377-586bd86454-q7jcn_23a8fee5-adee-41fd-a03c-365b60bc9f97/maas-api/0.log" Jul 16 13:18:41.117447 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:41.117411 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-b0d8b7c2-59887765cb-6ccdw_d5bd3b8b-ce63-400a-bfa5-a77290418952/maas-api/0.log" Jul 16 13:18:41.240245 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:41.240162 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-ae18e9-7d5bf4447-z9p5q_16fc2a43-67b5-4b82-8935-0ea765edae81/maas-api/0.log" Jul 16 13:18:41.367398 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:41.367368 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-cb4eee-66bb77b785-5xsbj_149bb4c4-f20b-4a35-b8ba-5b44939299b7/maas-api/0.log" Jul 16 13:18:41.500168 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:41.500086 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-5a470a1b-6ff7fc5489-9rcvs_a553712a-58e0-4c8b-ae5f-7aa238ffd79b/maas-api/0.log" Jul 16 13:18:41.626439 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:41.626407 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-41581b25-86b7947bdb-tstkx_dd71aa3c-47ce-42cb-9bfb-4d78e80b8892/maas-api/0.log" Jul 16 13:18:41.750608 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:41.750515 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-b12c92-85cc9fbbc7-vn7b9_eda9e00c-109f-4bbb-942e-5c0e2504d319/maas-api/0.log" Jul 16 13:18:42.020066 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:42.019984 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736780-xxh4m_8f9f53b6-462d-4689-b069-8da4e12c7704/cleanup/0.log" Jul 16 13:18:42.137282 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:42.137249 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736795-m57p8_3d032658-9d5a-47d3-8637-53dfadd35fee/cleanup/0.log" Jul 16 13:18:43.427825 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:43.427792 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-x7qwv_06feb07c-ffaa-4654-aa3a-cb82938f72a6/postgres/0.log" Jul 16 13:18:46.231565 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:46.231526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gzk2b_fd257892-d1b0-4c08-b7c2-6fbcea34b598/discovery/0.log" Jul 16 13:18:46.738018 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:46.737982 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-nzgrl_6eb79286-9a2c-4e3b-83c6-462421996f12/payload-pre-processing/0.log" Jul 16 13:18:46.866013 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:46.865968 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mcww_086c19d3-dd99-46f9-bfe0-6c6135304858/payload-processing/0.log" Jul 16 13:18:47.329461 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:47.329431 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bz7mk_dd2ee69f-05a8-47c7-8e5b-28f62898e954/main/0.log" Jul 16 13:18:47.605751 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:47.605702 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-spshq_5c9665d5-1e9c-4396-bfb5-3d4f1d60a5db/main/0.log" Jul 16 13:18:57.275700 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:57.275669 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n2596_9334156f-b91f-4e46-be62-df2ebb2b746e/global-pull-secret-syncer/0.log" Jul 16 13:18:57.433627 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:57.433599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9tbsr_971d554c-272a-4b67-8d77-219e233949cf/konnectivity-agent/0.log" Jul 16 13:18:57.511960 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:18:57.511931 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-248.ec2.internal_2b5c4ad47968662d249911b30e17464c/haproxy/0.log" Jul 16 13:19:04.131544 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.131451 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/alertmanager/0.log" Jul 16 13:19:04.166980 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.166949 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/config-reloader/0.log" Jul 16 13:19:04.208630 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.208598 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/kube-rbac-proxy-web/0.log" Jul 16 13:19:04.245848 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.245823 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/kube-rbac-proxy/0.log" Jul 16 13:19:04.274359 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.274319 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/kube-rbac-proxy-metric/0.log" Jul 16 13:19:04.294810 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.294784 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/prom-label-proxy/0.log" Jul 16 13:19:04.327675 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.327642 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07c66b3f-527a-4323-8976-223997fceda9/init-config-reloader/0.log" Jul 16 13:19:04.595987 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.595958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d5b65687b-wl5dd_153ca75e-6f99-40d0-96b6-06fe95e372d8/metrics-server/0.log" Jul 16 13:19:04.644063 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.644028 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-ldwb2_a5715ddb-f521-45dc-9cee-cb19fe6ff4d4/monitoring-plugin/0.log" Jul 16 13:19:04.794217 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.794129 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-knsk6_2983b61d-dc0b-466e-b243-d2a87c233185/node-exporter/0.log" Jul 16 13:19:04.832983 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.832948 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-knsk6_2983b61d-dc0b-466e-b243-d2a87c233185/kube-rbac-proxy/0.log" Jul 16 13:19:04.867632 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:04.867606 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-knsk6_2983b61d-dc0b-466e-b243-d2a87c233185/init-textfile/0.log" Jul 16 13:19:05.028917 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.028883 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-phmpm_5c4fe875-c772-4d8c-811b-24c0f704507f/kube-rbac-proxy-main/0.log" Jul 16 13:19:05.070870 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.070787 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-phmpm_5c4fe875-c772-4d8c-811b-24c0f704507f/kube-rbac-proxy-self/0.log" Jul 16 13:19:05.111303 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.111270 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-phmpm_5c4fe875-c772-4d8c-811b-24c0f704507f/openshift-state-metrics/0.log" Jul 16 13:19:05.168086 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.168054 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/prometheus/0.log" Jul 16 13:19:05.210937 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.210908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/config-reloader/0.log" Jul 16 13:19:05.255019 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.254991 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/thanos-sidecar/0.log" Jul 16 13:19:05.304944 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.304911 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/kube-rbac-proxy-web/0.log" Jul 16 13:19:05.349795 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.349768 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/kube-rbac-proxy/0.log" Jul 16 13:19:05.389130 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.389097 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/kube-rbac-proxy-thanos/0.log" Jul 16 13:19:05.423749 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.423708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7678f2d-cc9b-444f-b023-b692f53aecc0/init-config-reloader/0.log" Jul 16 13:19:05.545375 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.545350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-24mqt_ee50606f-68b6-41d8-b2c4-b3791913ad63/prometheus-operator-admission-webhook/0.log" Jul 16 13:19:05.583073 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.583047 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b9f6bd4-ctnrx_ea6f5d1c-4763-4f34-8cb2-c5010b4953ef/telemeter-client/0.log" Jul 16 13:19:05.628800 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.628709 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b9f6bd4-ctnrx_ea6f5d1c-4763-4f34-8cb2-c5010b4953ef/reload/0.log" Jul 16 13:19:05.666905 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.666876 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b9f6bd4-ctnrx_ea6f5d1c-4763-4f34-8cb2-c5010b4953ef/kube-rbac-proxy/0.log" Jul 16 13:19:05.714253 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.714224 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c767-jwwmx_de610a16-a14c-4048-b894-852c8f5660e1/thanos-query/0.log" Jul 16 13:19:05.751997 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.751964 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c767-jwwmx_de610a16-a14c-4048-b894-852c8f5660e1/kube-rbac-proxy-web/0.log" Jul 16 13:19:05.792694 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.792666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c767-jwwmx_de610a16-a14c-4048-b894-852c8f5660e1/kube-rbac-proxy/0.log" Jul 16 13:19:05.830723 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.830694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c767-jwwmx_de610a16-a14c-4048-b894-852c8f5660e1/prom-label-proxy/0.log" Jul 16 13:19:05.874882 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.874847 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c767-jwwmx_de610a16-a14c-4048-b894-852c8f5660e1/kube-rbac-proxy-rules/0.log" Jul 16 13:19:05.916880 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:05.916786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-774995c767-jwwmx_de610a16-a14c-4048-b894-852c8f5660e1/kube-rbac-proxy-metrics/0.log" Jul 16 13:19:07.992716 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.992681 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw"] Jul 16 13:19:07.993180 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.993166 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d032658-9d5a-47d3-8637-53dfadd35fee" containerName="cleanup" Jul 16 13:19:07.993180 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.993181 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d032658-9d5a-47d3-8637-53dfadd35fee" containerName="cleanup" Jul 16 13:19:07.993271 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.993263 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d032658-9d5a-47d3-8637-53dfadd35fee" containerName="cleanup" Jul 16 13:19:07.996666 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.996648 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:07.998939 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.998922 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-48rx4\"/\"kube-root-ca.crt\"" Jul 16 13:19:07.999657 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.999643 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-48rx4\"/\"default-dockercfg-rvmwq\"" Jul 16 13:19:07.999704 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:07.999644 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-48rx4\"/\"openshift-service-ca.crt\"" Jul 16 13:19:08.004432 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.004409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw"] Jul 16 13:19:08.137041 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.137003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-lib-modules\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.137212 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.137052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-proc\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.137212 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.137105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkqsk\" (UniqueName: \"kubernetes.io/projected/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-kube-api-access-tkqsk\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.137212 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.137153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-podres\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.137318 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.137259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-sys\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238676 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-sys\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-lib-modules\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-proc\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkqsk\" (UniqueName: \"kubernetes.io/projected/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-kube-api-access-tkqsk\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-podres\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238845 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-proc\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-sys\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.238895 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238875 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-lib-modules\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.239175 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.238989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-podres\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.247088 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.247037 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkqsk\" (UniqueName: \"kubernetes.io/projected/3084fe7b-cc8f-4895-90f6-a7f17fbdce1c-kube-api-access-tkqsk\") pod \"perf-node-gather-daemonset-bwpqw\" (UID: \"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c\") " pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.307341 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.307311 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:08.327205 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.327179 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-tz9hc_f548ed0a-c0e4-4e7d-83bb-80a796182f78/download-server/0.log" Jul 16 13:19:08.453195 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:08.453168 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw"] Jul 16 13:19:08.455421 ip-10-0-143-248 kubenswrapper[2567]: W0716 13:19:08.455390 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3084fe7b_cc8f_4895_90f6_a7f17fbdce1c.slice/crio-7f12d861928284fd9bc6bd965e7a16a364109fb7069efbf9ab2c339de52c7e82 WatchSource:0}: Error finding container 7f12d861928284fd9bc6bd965e7a16a364109fb7069efbf9ab2c339de52c7e82: Status 404 returned error can't find the container with id 7f12d861928284fd9bc6bd965e7a16a364109fb7069efbf9ab2c339de52c7e82 Jul 16 13:19:09.178918 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:09.178883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" event={"ID":"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c","Type":"ContainerStarted","Data":"eeb372e0a2c5037b42cc60c621903d54f8079cf7c64c4be2f250c3f265f4a752"} Jul 16 13:19:09.179306 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:09.178942 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" event={"ID":"3084fe7b-cc8f-4895-90f6-a7f17fbdce1c","Type":"ContainerStarted","Data":"7f12d861928284fd9bc6bd965e7a16a364109fb7069efbf9ab2c339de52c7e82"} Jul 16 13:19:09.179306 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:09.178973 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:09.198746 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:09.198694 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" podStartSLOduration=2.198678423 podStartE2EDuration="2.198678423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:19:09.196410169 +0000 UTC m=+2390.858070251" watchObservedRunningTime="2026-07-16 13:19:09.198678423 +0000 UTC m=+2390.860338506" Jul 16 13:19:09.965363 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:09.965328 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9bz5m_37af210d-b579-4255-b88d-f386e9128f79/dns/0.log" Jul 16 13:19:09.987197 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:09.987171 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9bz5m_37af210d-b579-4255-b88d-f386e9128f79/kube-rbac-proxy/0.log" Jul 16 13:19:10.056151 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:10.056124 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4lld_2f29178a-d849-4a92-a61f-6e894e5786e0/dns-node-resolver/0.log" Jul 16 13:19:10.694710 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:10.694678 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98p2d_6ecced20-759e-4625-a40e-8e953c9da289/node-ca/0.log" Jul 16 13:19:11.842559 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:11.842525 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gzk2b_fd257892-d1b0-4c08-b7c2-6fbcea34b598/discovery/0.log" Jul 16 13:19:11.970194 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:11.970160 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-nzgrl_6eb79286-9a2c-4e3b-83c6-462421996f12/payload-pre-processing/0.log" Jul 16 13:19:12.008639 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:12.008604 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mcww_086c19d3-dd99-46f9-bfe0-6c6135304858/payload-processing/0.log" Jul 16 13:19:12.689369 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:12.689340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-68d8z_5a3404a9-3e61-4fbb-a1ab-8822c9db3a7d/serve-healthcheck-canary/0.log" Jul 16 13:19:13.284931 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:13.284893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bw7c4_9639b256-b79b-4e6f-9e33-41d9249cf939/kube-rbac-proxy/0.log" Jul 16 13:19:13.306762 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:13.306714 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bw7c4_9639b256-b79b-4e6f-9e33-41d9249cf939/exporter/0.log" Jul 16 13:19:13.325980 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:13.325951 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bw7c4_9639b256-b79b-4e6f-9e33-41d9249cf939/extractor/0.log" Jul 16 13:19:15.195858 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:15.195829 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-48rx4/perf-node-gather-daemonset-bwpqw" Jul 16 13:19:15.739573 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:15.739544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c685789b-2h6x4_0f80b32f-a100-4e06-b0d2-3042e27dd011/manager/0.log" Jul 16 13:19:16.128400 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:16.128362 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f8bdf75c-fgbzc_7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9/manager/0.log" Jul 16 13:19:16.146887 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:16.146854 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f8bdf75c-fgbzc_7e6f2f6b-2a2b-4ac5-85a8-dd2b41b154f9/copy-manifests/0.log" Jul 16 13:19:17.345677 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:17.345642 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-596f9f8f6b-n4xfg_ceb21056-fe86-44c7-9152-040f5145c931/manager/0.log" Jul 16 13:19:17.536385 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:17.536350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gzk2b_fd257892-d1b0-4c08-b7c2-6fbcea34b598/discovery/0.log" Jul 16 13:19:17.653283 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:17.653248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-nzgrl_6eb79286-9a2c-4e3b-83c6-462421996f12/payload-pre-processing/0.log" Jul 16 13:19:17.684665 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:17.684631 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mcww_086c19d3-dd99-46f9-bfe0-6c6135304858/payload-processing/0.log" Jul 16 13:19:18.998405 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:18.998281 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:19:19.006419 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:19.006396 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:19:19.246017 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:19.245979 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gzk2b_fd257892-d1b0-4c08-b7c2-6fbcea34b598/discovery/0.log" Jul 16 13:19:19.350531 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:19.350499 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-nzgrl_6eb79286-9a2c-4e3b-83c6-462421996f12/payload-pre-processing/0.log" Jul 16 13:19:19.381111 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:19.381082 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4mcww_086c19d3-dd99-46f9-bfe0-6c6135304858/payload-processing/0.log" Jul 16 13:19:22.497613 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:22.497580 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-dnwqt_d81b0e13-6107-4d20-8334-bbb8e63a05f7/migrator/0.log" Jul 16 13:19:22.517508 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:22.517477 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-dnwqt_d81b0e13-6107-4d20-8334-bbb8e63a05f7/graceful-termination/0.log" Jul 16 13:19:24.301209 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.301185 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/kube-multus-additional-cni-plugins/0.log" Jul 16 13:19:24.326019 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.325989 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/egress-router-binary-copy/0.log" Jul 16 13:19:24.345258 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.345230 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/cni-plugins/0.log" Jul 16 13:19:24.363677 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.363651 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/bond-cni-plugin/0.log" Jul 16 13:19:24.382593 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.382565 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/routeoverride-cni/0.log" Jul 16 13:19:24.406078 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.406055 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/whereabouts-cni-bincopy/0.log" Jul 16 13:19:24.427860 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.427826 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x2zfh_ae5a4427-93c7-45dc-879a-9bbe2100fa19/whereabouts-cni/0.log" Jul 16 13:19:24.467838 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.467808 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bftcm_85d3ae17-677b-4cc3-82d9-f08a2b3ec188/kube-multus/0.log" Jul 16 13:19:24.611847 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.611805 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w7h87_174ca112-4d79-4fba-92d3-af4b905da5f7/network-metrics-daemon/0.log" Jul 16 13:19:24.630303 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:24.630273 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w7h87_174ca112-4d79-4fba-92d3-af4b905da5f7/kube-rbac-proxy/0.log" Jul 16 13:19:25.872785 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.872750 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-controller/0.log" Jul 16 13:19:25.887909 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.887869 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/0.log" Jul 16 13:19:25.887909 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.887906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovn-acl-logging/1.log" Jul 16 13:19:25.906617 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.906594 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/kube-rbac-proxy-node/0.log" Jul 16 13:19:25.931055 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.931022 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 13:19:25.951220 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.951189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/northd/0.log" Jul 16 13:19:25.969681 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.969652 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/nbdb/0.log" Jul 16 13:19:25.988444 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:25.988411 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/sbdb/0.log" Jul 16 13:19:26.062569 ip-10-0-143-248 kubenswrapper[2567]: I0716 13:19:26.062537 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wtxb9_b26a799c-13a5-42ee-8f2a-9074999b181b/ovnkube-controller/0.log"